-- Logs begin at Tue 2021-05-25 15:01:11 UTC, end at Tue 2021-05-25 16:30:27 UTC. -- May 25 15:33:13.348069 dv-cinder-786383-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service. May 25 15:33:14.306800 dv-cinder-786383-6-iscsi neutron-server[98286]: Beware of the coming changes in the project packaging May 25 15:33:14.307400 dv-cinder-786383-6-iscsi neutron-server[98286]: https://github.com/svinota/pyroute2/discussions/786 May 25 15:33:15.792715 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.common.config [-] Logging enabled! May 25 15:33:15.793270 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 15:33:15.793474 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98286) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 15:33:15.796725 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.common.config [-] Logging enabled! May 25 15:33:15.796994 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 15:33:15.797300 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98286) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 15:33:15.798228 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:33:15.798462 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:33:15.798817 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:33:15.799063 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:33:15.799290 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:33:15.799639 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.799938 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.800235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.800467 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.800759 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.801048 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.801331 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.801626 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.801922 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.802235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.802515 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.802799 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.803031 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.803315 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] config_source = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.803632 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.803924 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.804150 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] debug = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.804432 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.804858 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.805262 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.805543 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.805832 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.806110 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.806382 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.806657 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.806939 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.807266 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] host = dv-cinder-786383-6-iscsi {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.807572 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.807856 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.808143 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.808431 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.808707 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.808986 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.809272 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.809548 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_dir = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.809824 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.810102 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.810391 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.810680 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.810976 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.811202 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.811427 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.811744 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.812035 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.812311 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.812585 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.812860 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.813132 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.813404 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.813672 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.813958 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.814243 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.814527 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.814800 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.815075 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.815347 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.815651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.815942 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.816217 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.816491 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.816765 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.817051 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.817321 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.817596 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.818418 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.818708 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.818993 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.819282 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.819581 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.819866 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.820140 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.820416 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_journal = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.820692 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_json = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.820965 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.821237 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.821525 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.821797 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.822074 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.822352 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.822621 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.822906 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:15.823201 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.823499 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.823825 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.824112 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.824410 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.824690 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.824982 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.825263 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.825553 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.825844 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.826133 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.826413 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.826705 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.826981 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.827275 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.827605 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.828030 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.828333 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.828615 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.828894 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.829171 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.829451 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.829738 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.830036 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.830330 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.830608 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.830888 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.831180 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.831457 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.831759 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.832044 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.832336 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.832615 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.832889 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.833170 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.834339 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.834615 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.834890 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.835170 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.835462 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.835773 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.836049 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.836321 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.836599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.836873 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.837161 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.837443 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.837721 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.837997 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.838276 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.838551 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.838826 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.839105 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.839380 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.839686 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.839962 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.840237 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.840511 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.840788 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.841060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.841332 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.841605 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.841881 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.842157 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.842431 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.842704 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.842977 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.843252 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.843538 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.843862 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.844139 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.844416 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.844692 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.844969 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.845245 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.845520 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.845796 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.846070 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.846339 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.846628 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.846911 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.847195 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.847480 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.847779 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.848076 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.848351 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.848636 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.848937 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.849217 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.849504 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.849789 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.850084 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.850377 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.850672 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.850967 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.851261 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.851542 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.851870 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.852154 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:15.852371 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:33:15.852608 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98286) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 25 15:33:16.216034 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:16.216308 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:16.216597 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:16.217079 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [-] Loading core plugin: ml2 May 25 15:33:16.608695 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.609008 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.609253 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.610440 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.610714 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.610977 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.645889 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.646168 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.646435 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.659221 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.659503 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.659796 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.689751 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.690032 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.690296 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.726630 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.726909 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.727172 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.956578 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.957229 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.957229 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.957403 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:16.958033 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.081770 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.082088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.082369 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.082644 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.082910 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.083215 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.084252 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.084517 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.084771 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.085053 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.085310 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.085571 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.085835 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.086090 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.086376 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.086625 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.087914 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.088209 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.088480 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.088774 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.089207 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.089479 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.089735 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.090026 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.090284 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.090537 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.090916 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.091159 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.091403 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.091671 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.091913 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.092152 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.092517 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 25 15:33:17.095577 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 25 15:33:17.099993 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 25 15:33:17.103681 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(800, 849)])]) May 25 15:33:17.105318 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 25 15:33:17.105746 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 25 15:33:17.106079 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 25 15:33:17.106462 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 25 15:33:17.109399 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 25 15:33:17.109660 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 25 15:33:17.110006 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 25 15:33:17.136658 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 25 15:33:17.137104 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.137402 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98286) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 25 15:33:17.137764 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.139107 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98286) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 25 15:33:17.139390 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 25 15:33:17.139663 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 25 15:33:17.142846 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.143131 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.220470 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 25 15:33:17.220665 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 25 15:33:17.220913 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 25 15:33:17.221277 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 25 15:33:17.250994 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_db.sqlalchemy.engines [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:33:17.580226 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing driver for type 'gre' May 25 15:33:17.580742 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] gre ID ranges: [(1, 1000)] May 25 15:33:17.628867 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing driver for type 'local' May 25 15:33:17.629207 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing driver for type 'vlan' May 25 15:33:17.641447 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] VlanTypeDriver initialization complete May 25 15:33:17.641776 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing driver for type 'vxlan' May 25 15:33:17.642280 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] vxlan ID ranges: [(1, 1000)] May 25 15:33:17.687389 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing extension driver 'port_security' May 25 15:33:17.687755 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.extensions.port_security [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] PortSecurityExtensionDriver initialization complete May 25 15:33:17.688096 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing mechanism driver 'openvswitch' May 25 15:33:17.688419 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing mechanism driver 'hyperv' May 25 15:33:17.695570 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.plugins.ml2.plugin [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:17.696353 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.696733 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.697087 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.697475 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.697831 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.698175 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.698557 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.698906 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.699248 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.699667 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.700020 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.700363 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.700743 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.701092 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.701430 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.701804 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > address_group after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.702147 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > address_group after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.702484 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > address_group after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.702821 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] ML2 OVO RPC backend initialized. {{(pid=98286) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}} May 25 15:33:17.703536 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.703918 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.704334 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.704681 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > networks before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.705034 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.705373 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > ports before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.705715 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.706053 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnets before_response 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.706401 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.706738 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.707071 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.707405 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.707770 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.708103 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.708473 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.708812 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.709403 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > subnet after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.709984 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.plugin [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Modular L2 Plugin initialization complete May 25 15:33:17.710311 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading services supported by the core plugin {{(pid=98286) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 25 15:33:17.710638 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.plugins.ml2.managers [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Got port-security extension from driver 'port_security' May 25 15:33:17.711114 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.extensions.vlantransparent [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Disabled vlantransparent extension. May 25 15:33:17.711623 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98286) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 25 15:33:17.711940 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: router May 25 15:33:17.749009 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.749407 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_create 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.749780 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router before_create 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.750149 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.750520 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.750878 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_delete 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.751238 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > floatingip after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.751639 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_create 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.751990 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.752341 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.752689 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.753048 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.753454 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.753828 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.754177 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.754518 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: subnet after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.754856 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.755895 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > port precommit_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.756255 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_create 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.756605 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.756954 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.757316 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router after_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.757662 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_delete 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.758012 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_create 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.758374 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router_interface after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.758720 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_update 55549900 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.759091 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > network after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.759971 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Tracking information for resource: router configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.760308 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Tracking information for resource: floatingip configured {{(pid=98286) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:33:17.765202 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.db.l3_agentschedulers_db [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 25 15:33:17.765782 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.766145 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.766501 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.766853 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: port after_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.767680 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router before_create 55550100 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.768050 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_delete 55550100 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.768413 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_create 55550100 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.768771 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > router precommit_update 55550100 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.773312 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.provider_configuration [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service providers = [] {{(pid=98286) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 25 15:33:17.773676 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.db.servicetype_db [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98286) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 25 15:33:17.776583 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.service_base [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98286) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:33:17.776934 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.service_base [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98286) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:33:17.777275 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.service_base [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98286) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:33:17.778155 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.services.service_base [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98286) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:33:17.778527 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.services.service_base [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Default provider is not specified for service type L3_ROUTER_NAT May 25 15:33:17.779059 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.779381 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 25 15:33:17.789797 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.790136 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: auto_allocate May 25 15:33:17.795757 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: network precommit_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.796125 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: network precommit_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.796639 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.796957 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: tag May 25 15:33:17.804232 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.804558 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: timestamp May 25 15:33:17.808298 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.808632 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: network_ip_availability May 25 15:33:17.813804 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.814180 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.814534 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:17.815238 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.815575 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: flavors May 25 15:33:17.821140 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.821479 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading Plugin: revisions May 25 15:33:17.825732 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98286) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:33:17.826117 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.609s {{(pid=98286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:17.826849 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98286) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} May 25 15:33:17.827182 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Initializing extension manager. May 25 15:33:17.827729 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: __init__.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.828071 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: __pycache__ {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.828404 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.828737 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: address_group.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.829485 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.830040 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: address-group May 25 15:33:17.830408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: address_scope.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.831074 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.831608 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: address-scope May 25 15:33:17.831935 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: admin_state_down_before_update.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.832863 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.833395 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: router-admin-state-down-before-update May 25 15:33:17.833717 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: agent.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.834687 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.835187 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: agent May 25 15:33:17.835509 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: agent_resources_synced.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.836431 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.836935 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: agent-resources-synced May 25 15:33:17.837259 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: allowedaddresspairs.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.839004 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.839523 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: allowed-address-pairs May 25 15:33:17.839883 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: auto_allocated_topology.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.840950 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.841464 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: auto-allocated-topology May 25 15:33:17.841792 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: availability_zone.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.842483 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.842994 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: availability_zone May 25 15:33:17.843322 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: availability_zone_filter.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.844257 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.844762 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: availability_zone_filter May 25 15:33:17.845086 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: data_plane_status.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.845981 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.846480 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension data-plane-status not supported by any of loaded plugins May 25 15:33:17.846801 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: default_subnetpools.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.847733 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.848239 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: default-subnetpools May 25 15:33:17.848562 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: dhcpagentscheduler.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.849388 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.849891 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: dhcp_agent_scheduler May 25 15:33:17.850214 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: dns.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.851114 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.851648 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension dns-integration not supported by any of loaded plugins May 25 15:33:17.851975 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: dns_domain_ports.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.852888 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.853384 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension dns-domain-ports not supported by any of loaded plugins May 25 15:33:17.853708 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: dvr.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.854380 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.854883 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: dvr May 25 15:33:17.855204 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: empty_string_filtering.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.856126 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.856633 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: empty-string-filtering May 25 15:33:17.856953 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.857848 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.858349 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 25 15:33:17.858670 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.859587 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.860095 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 25 15:33:17.860417 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: external_net.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.861305 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.861812 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: external-net May 25 15:33:17.862133 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: extra_dhcp_opt.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.863058 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.863568 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: extra_dhcp_opt May 25 15:33:17.863904 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: extraroute.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.865315 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.865816 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: extraroute May 25 15:33:17.866136 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: extraroute_atomic.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.867162 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.867706 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: extraroute-atomic May 25 15:33:17.868029 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: filter_validation.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.868680 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.869177 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: filter-validation May 25 15:33:17.869496 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: fip_pf_description.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.870558 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.871057 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 25 15:33:17.871378 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: fip_port_details.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.872308 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.872816 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: fip-port-details May 25 15:33:17.873136 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: flavors.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.874345 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.874862 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: flavors May 25 15:33:17.875186 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.876864 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.877385 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 25 15:33:17.877720 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: floatingip_pools.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.878421 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.878928 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: floatingip-pools May 25 15:33:17.879256 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: ip_allocation.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.880801 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.881314 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension ip_allocation not supported by any of loaded plugins May 25 15:33:17.881638 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.882544 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.883053 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: ip-substring-filtering May 25 15:33:17.883380 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l2_adjacency.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.884324 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.884833 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension l2_adjacency not supported by any of loaded plugins May 25 15:33:17.885158 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.886104 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.886619 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: router May 25 15:33:17.886946 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3_conntrack_helper.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.889173 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.889699 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 25 15:33:17.890033 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.890955 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.891472 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: ext-gw-mode May 25 15:33:17.891826 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.892735 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.893243 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: l3-ha May 25 15:33:17.893570 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3_flavors.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.894473 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.894979 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: l3-flavors May 25 15:33:17.895303 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.896273 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.896778 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: l3-port-ip-change-not-allowed May 25 15:33:17.897101 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: l3agentscheduler.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.898154 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.898664 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: l3_agent_scheduler May 25 15:33:17.898991 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: logging.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.900494 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.901007 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension logging not supported by any of loaded plugins May 25 15:33:17.901337 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: metering.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.902067 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.902635 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: metering May 25 15:33:17.902964 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.904088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.904607 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: metering_source_and_destination_fields May 25 15:33:17.904932 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: multiprovidernet.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.905971 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.906485 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: multi-provider May 25 15:33:17.906820 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: netmtu.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.907752 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.908267 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: net-mtu May 25 15:33:17.908594 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: netmtu_writable.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.909509 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.910020 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: net-mtu-writable May 25 15:33:17.910344 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: network_availability_zone.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.911003 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.911540 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: network_availability_zone May 25 15:33:17.911908 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: network_ip_availability.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.913025 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.913518 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: network-ip-availability May 25 15:33:17.913839 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: network_segment_range.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.914615 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.915116 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension network-segment-range not supported by any of loaded plugins May 25 15:33:17.915438 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: pagination.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.916428 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.916758 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: pagination May 25 15:33:17.917080 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: port_device_profile.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.917972 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.918484 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: port-device-profile May 25 15:33:17.918808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.919751 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.920258 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: port-mac-address-regenerate May 25 15:33:17.920579 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.921468 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.921973 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: port-numa-affinity-policy May 25 15:33:17.922297 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: port_resource_request.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.923187 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.923730 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension port-resource-request not supported by any of loaded plugins May 25 15:33:17.924055 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: portbindings.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.924970 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.925472 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: binding May 25 15:33:17.925795 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: portbindings_extended.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.927591 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.928108 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: binding-extended May 25 15:33:17.928434 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: portsecurity.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.929336 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.929842 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: port-security May 25 15:33:17.930166 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: project_id.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.931119 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.931448 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: project-id May 25 15:33:17.931806 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: providernet.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.932704 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.933213 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: provider May 25 15:33:17.933536 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.937022 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.937546 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos not supported by any of loaded plugins May 25 15:33:17.937881 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.939110 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.939659 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 25 15:33:17.939992 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.940905 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.941429 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 25 15:33:17.941750 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_default.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.943212 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.943777 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-default not supported by any of loaded plugins May 25 15:33:17.944108 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_fip.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.944758 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.945270 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-fip not supported by any of loaded plugins May 25 15:33:17.945594 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_gateway_ip.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.946516 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.947025 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-gateway-ip not supported by any of loaded plugins May 25 15:33:17.947350 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_port_network_policy.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.948275 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.948783 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-port-network-policy not supported by any of loaded plugins May 25 15:33:17.949107 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_rule_type_details.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.950010 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.950517 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-rule-type-details not supported by any of loaded plugins May 25 15:33:17.950839 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: qos_rules_alias.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.951907 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.952425 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension qos-rules-alias not supported by any of loaded plugins May 25 15:33:17.952751 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: quotasv2.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.953770 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.954099 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: quotas May 25 15:33:17.954422 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: quotasv2_detail.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.956056 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.956394 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: quota_details May 25 15:33:17.956722 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: rbac.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.957773 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.958316 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: rbac-policies May 25 15:33:17.958651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: rbac_address_group.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.961060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.961060 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: rbac-address-group May 25 15:33:17.961060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: rbac_address_scope.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.961588 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.962083 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: rbac-address-scope May 25 15:33:17.962406 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: rbac_security_groups.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.963310 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.963839 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: rbac-security-groups May 25 15:33:17.964164 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: rbac_subnetpool.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.965092 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.965599 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: rbac-subnetpool May 25 15:33:17.965924 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: revisionifmatch.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.966832 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.967339 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: revision-if-match May 25 15:33:17.967702 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: revisions.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.968811 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.969320 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: standard-attr-revisions May 25 15:33:17.969650 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: router_availability_zone.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.970322 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.970832 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: router_availability_zone May 25 15:33:17.971158 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: routerservicetype.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.972101 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.972619 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension router-service-type not supported by any of loaded plugins May 25 15:33:17.972947 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.973862 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.974899 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: security-groups-normalized-cidr May 25 15:33:17.975224 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: security_groups_port_filtering.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.976176 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.976687 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: port-security-groups-filtering May 25 15:33:17.977013 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.977923 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.978433 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: security-groups-remote-address-group May 25 15:33:17.978759 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: securitygroup.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.988325 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.988883 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: security-group May 25 15:33:17.989222 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: segment.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.990648 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.991159 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension segment not supported by any of loaded plugins May 25 15:33:17.991490 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.992525 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.993037 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 25 15:33:17.993365 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: servicetype.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.994490 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.995005 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: service-type May 25 15:33:17.995334 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: sorting.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.996346 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.996684 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: sorting May 25 15:33:17.997010 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: standard_attr_segment.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.997910 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.998424 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension standard-attr-segment not supported by any of loaded plugins May 25 15:33:17.998751 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: standardattrdescription.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:17.999395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:17.999997 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: standard-attr-description May 25 15:33:18.000327 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: stateful_security_group.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.001248 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.001760 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: stateful-security-group May 25 15:33:18.002085 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: stdattrs_common.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.002663 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 25 15:33:18.002985 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.004098 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.004609 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 25 15:33:18.004934 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnet_onboard.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.006102 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.006623 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: subnet_onboard May 25 15:33:18.006949 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.008009 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.008558 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 25 15:33:18.008919 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnet_service_types.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.009852 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.010367 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: subnet-service-types May 25 15:33:18.010696 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnetallocation.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.011801 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.012322 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: subnet_allocation May 25 15:33:18.012651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.013315 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.013825 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: subnetpool-prefix-ops May 25 15:33:18.014152 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.015067 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.015610 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 25 15:33:18.015940 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: tagging.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.017019 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.017534 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: standard-attr-tag May 25 15:33:18.017864 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: timestamp.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.019063 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.019606 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loaded extension: standard-attr-timestamp May 25 15:33:18.019941 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: trunk.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.020991 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.021506 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension trunk not supported by any of loaded plugins May 25 15:33:18.021833 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: trunk_details.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.022748 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.023260 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension trunk-details not supported by any of loaded plugins May 25 15:33:18.023619 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: uplink_status_propagation.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.024528 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.025037 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension uplink-status-propagation not supported by any of loaded plugins May 25 15:33:18.025364 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Loading extension file: vlantransparent.py {{(pid=98286) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:33:18.026040 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98286) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:33:18.026542 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extension vlan-transparent not supported by any of loaded plugins May 25 15:33:18.029065 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:network May 25 15:33:18.029826 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnet May 25 15:33:18.031762 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:33:18.032400 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:port May 25 15:33:18.033679 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.034116 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service FLAVORS assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.034745 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.035179 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.035519 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:router May 25 15:33:18.036205 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:floatingip May 25 15:33:18.037429 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service METERING assigned prefix: /metering {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.038869 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:18.039239 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:18.039619 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:33:18.040755 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of CountableResource for resource:rbac_policy May 25 15:33:18.041204 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:security_group May 25 15:33:18.041878 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:security_group_rule May 25 15:33:18.042613 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service CORE assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.042945 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:33:18.043283 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] subnetpool is already registered May 25 15:33:18.043915 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service CORE assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.044248 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:33:18.044585 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] subnetpool is already registered May 25 15:33:18.047161 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.047623 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service FLAVORS assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.048218 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.048640 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.048972 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:router May 25 15:33:18.049300 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] router is already registered May 25 15:33:18.049891 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:floatingip May 25 15:33:18.050218 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] floatingip is already registered May 25 15:33:18.050845 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service METERING assigned prefix: /metering {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.051519 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of CountableResource for resource:rbac_policy May 25 15:33:18.051873 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] rbac_policy is already registered May 25 15:33:18.053074 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:security_group May 25 15:33:18.053401 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] security_group is already registered May 25 15:33:18.054000 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:security_group_rule May 25 15:33:18.054342 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] security_group_rule is already registered May 25 15:33:18.055024 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service CORE assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.055352 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:33:18.055721 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] subnetpool is already registered May 25 15:33:18.056340 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.v2.resource_helper [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Service CORE assigned prefix: {{(pid=98286) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:33:18.056670 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:33:18.056996 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING neutron.quota.resource_registry [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] subnetpool is already registered May 25 15:33:18.057634 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: extensions {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.059123 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: address-groups {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.060774 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: address-scopes {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.061971 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: agents {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.063117 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: auto-allocated-topology {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.064423 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: availability_zones {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.065728 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: dhcp-networks {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.067169 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: dhcp-agents {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.068668 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: routers {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.070461 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: flavors {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.071646 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: service_profiles {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.072852 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: next_providers {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.074360 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: service_profiles {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.075837 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: floatingip-pools {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.077036 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: routers {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.078852 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: floatingips {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.080076 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: l3-routers {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.081502 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: l3-agents {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.082832 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: metering-labels {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.084508 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: metering-label-rules {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.085824 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: network-ip-availabilities {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.087068 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: bindings {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.088771 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: quotas {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.090209 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: quotas {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.091653 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: rbac-policies {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.092941 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: security-groups {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.094157 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: security-group-rules {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.095379 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: service-providers {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.096632 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: subnetpools {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.099507 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: subnetpools {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.100979 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.102690 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.213019 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.214808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.216601 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.218488 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.220199 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.222099 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.224366 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.226245 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron.api.extensions [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Extended resource: tags {{(pid=98286) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:33:18.232080 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING keystonemiddleware.auth_token [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:33:18.236792 dv-cinder-786383-6-iscsi neutron-server[98286]: WARNING keystonemiddleware.auth_token [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:33:18.245627 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Acquired lock "singleton_lock" {{(pid=98286) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 25 15:33:18.246114 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_concurrency.lockutils [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Releasing lock "singleton_lock" {{(pid=98286) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 25 15:33:18.246743 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Starting 2 workers May 25 15:33:18.251402 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Started child 98391 {{(pid=98286) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:33:18.255854 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Started child 98392 {{(pid=98286) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:33:18.256604 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.257406 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO neutron.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Neutron service started, listening on 0.0.0.0:9696 May 25 15:33:18.258055 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Notify callbacks [] for process, before_spawn {{(pid=98286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.258154 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [-] (98391) wsgi starting up on http://0.0.0.0:9696 May 25 15:33:18.260528 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Starting 1 workers May 25 15:33:18.260691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.262149 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [-] (98392) wsgi starting up on http://0.0.0.0:9696 May 25 15:33:18.265630 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Started child 98393 {{(pid=98286) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:33:18.266143 dv-cinder-786383-6-iscsi neutron-server[98286]: INFO oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Starting 1 workers May 25 15:33:18.269007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] calling RpcWorker wait() {{(pid=98393) _wait /opt/stack/neutron/neutron/service.py:128}} May 25 15:33:18.269545 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] returning from RpcWorker wait() {{(pid=98393) _wait /opt/stack/neutron/neutron/service.py:135}} May 25 15:33:18.270435 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Started child 98394 {{(pid=98286) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:33:18.270739 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.271203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:18.271298 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG neutron_lib.callbacks.manager [None req-0d2e7c5c-a0c6-49a2-b403-42f6f70717ea None None] Notify callbacks [] for process, after_spawn {{(pid=98286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.273252 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98286) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 15:33:18.273457 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:33:18.273647 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:33:18.273875 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:33:18.274236 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:33:18.274404 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:33:18.274920 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.275192 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.275462 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.275749 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.276046 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.276320 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.276796 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.276893 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.277130 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.277416 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.277679 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.277857 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.278028 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.278278 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.278532 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.278898 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.279149 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:18.279240 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.279413 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.279710 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.279889 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.280147 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.280421 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.280670 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.280950 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] debug = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.281217 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.281710 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.281940 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.282207 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.282433 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.282715 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.282965 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.283251 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.283488 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.283746 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.283981 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.284240 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.284484 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.284706 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.284945 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.285219 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.285462 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.285966 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] host = dv-cinder-786383-6-iscsi {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.286217 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.286955 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.287214 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.287463 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.287739 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.287962 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.288226 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.288489 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.288761 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.288994 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.289242 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.289493 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.289728 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.289982 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.290149 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_options = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.290388 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.290685 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291001 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291144 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291315 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291497 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291792 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.291960 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.292214 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.292526 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.292664 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.292879 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.293118 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.293335 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.293605 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.293839 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.294093 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.294306 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.294566 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.294828 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.295057 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.295308 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.295542 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.295782 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.296001 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.296238 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.296468 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.296712 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.296928 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298395 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298861 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.298861 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.299088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.299321 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.299826 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.299826 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.300053 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.300289 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.300527 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.300746 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.301265 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_json = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.301265 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.301616 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.301616 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.302956 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.302956 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.302956 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.303976 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.303976 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.303976 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.303976 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306920 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306920 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306920 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.306920 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.307212 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.307683 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.307802 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.308042 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.308271 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.308511 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.308772 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.309017 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.309353 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.25/identity {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312235 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.312808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.313090 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.313169 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.313346 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.313585 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.313815 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315115 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315115 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315115 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315115 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315115 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315528 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315528 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315699 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.315803 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.316062 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.316421 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.316527 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.316707 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318518 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318518 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318765 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.318990 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.319233 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.320582 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.321043 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.321043 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.321200 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.321408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.321630 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.324599 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.325175 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.325417 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328586 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328586 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.328752 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.329150 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.329150 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.329378 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.329666 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.329910 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.330149 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.330381 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.330627 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.330884 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.331181 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.331440 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.331779 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.332007 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.332287 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.332569 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.332795 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.333072 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.333326 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.333608 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.333905 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.334448 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.334723 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.334989 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.335234 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.335519 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.335782 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.336039 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.336277 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.336531 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.336777 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.337066 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.337309 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.337537 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.337758 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.337997 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.338306 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.338542 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.338765 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.338984 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.339254 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.339507 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.339783 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.340058 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.340310 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.340564 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.340816 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.341697 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.25/identity {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.341697 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.341697 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.341946 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.341946 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.342181 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.342433 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.342673 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.342909 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.343147 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.343397 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.343616 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.343833 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.344259 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.344259 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.344996 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.344996 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.344996 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.345262 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.345351 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.345574 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.345796 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.346043 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.346811 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.346811 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.346811 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.347071 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.347352 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.347684 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.348007 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.348250 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.348510 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.348733 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.349499 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.349724 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.349947 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.350162 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.350385 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.350601 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.350837 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.351098 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.351336 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.351580 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.351827 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.352152 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.352555 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.353038 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.353297 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.353539 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.353793 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.354034 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.354277 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.354517 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.354747 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.354955 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.355219 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.355462 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.355716 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.355931 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.356167 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.356382 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.356631 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.356845 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.357138 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.357412 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.357661 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.357885 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.358132 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.358378 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.358612 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.358832 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.359051 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.359264 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.359492 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.359730 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.359944 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.360190 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.360422 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.360779 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.360916 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.361482 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.361482 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.361747 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.361747 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.361958 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.362133 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.362352 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.362564 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.363050 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.363482 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.363900 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.364353 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.364657 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.365417 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.365702 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.366049 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.366291 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.366540 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.366764 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.366986 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.367218 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.367483 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.367845 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.368155 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.368438 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.368683 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.368982 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.369287 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.369538 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.369759 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.370073 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.370405 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.370692 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.370929 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.371164 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.371463 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.371719 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.371941 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.372192 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.372431 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.372651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.372892 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.373128 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.373381 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.373617 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.373853 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.374071 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.374318 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.374574 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.374797 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.375016 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.375176 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:33:18.375827 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98286) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 15:33:18.375992 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:33:18.376148 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:33:18.376318 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:33:18.376488 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:33:18.376643 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:33:18.376851 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377014 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377175 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377335 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377496 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377681 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.377844 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378004 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378164 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378324 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378485 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378644 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378808 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.378967 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.379127 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.379289 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.379448 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.379643 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.379812 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] debug = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380794 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380794 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.380952 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.381043 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.381208 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.381371 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.381529 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.382059 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.382380 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.382692 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.382853 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.383157 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.383470 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.383653 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.383810 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384027 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384144 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384278 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] host = dv-cinder-786383-6-iscsi {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384434 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384585 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384741 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.384926 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.385086 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.385207 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.385524 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.385685 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.385847 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386006 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386167 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386332 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386482 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386642 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386806 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_options = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.386964 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.387274 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.387433 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.387783 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.387948 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388090 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388251 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388413 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388573 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388732 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.388895 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389053 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389216 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389359 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389522 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389682 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.389841 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390052 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390270 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390409 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390557 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390695 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390852 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.390981 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391126 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391260 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391394 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391518 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391706 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.391869 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392006 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392135 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392285 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392413 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392547 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392679 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392811 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.392969 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393121 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393279 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393437 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393596 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393754 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.393913 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394088 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394253 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_json = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394386 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394530 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394659 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394818 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.394980 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.395139 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.395297 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.395459 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:33:18.395671 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.396348 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.396527 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.396692 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.396855 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397019 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397183 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397345 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397509 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397671 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.397841 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398004 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398177 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398340 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398504 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398670 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398834 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.398998 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399160 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399309 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:18.399410 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399493 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399652 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399831 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.399995 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400162 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.25/identity {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400325 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400488 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400652 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400816 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.400980 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401147 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401309 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401635 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401800 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.401964 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402129 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402284 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402424 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402591 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402754 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.402918 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403082 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403245 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403585 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403751 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.403915 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404079 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404234 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404404 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404567 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404731 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.404893 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405203 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405340 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405506 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405670 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405832 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.405995 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406170 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406333 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406501 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406640 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406797 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.406960 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407123 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407287 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407450 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407635 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407800 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.407954 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408114 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408279 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408431 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408580 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408744 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.408908 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409070 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409237 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409388 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409549 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409713 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.409884 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410221 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410443 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410651 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.410937 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.411075 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.411212 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.411350 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.411544 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412192 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412319 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412450 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412581 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412728 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.412889 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.413051 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.413419 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.413419 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.413419 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414015 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414740 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.414740 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415011 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415011 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415208 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415360 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415504 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415677 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.415884 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416053 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416184 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416357 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416522 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416647 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416776 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.416942 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417198 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417344 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417471 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417560 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417695 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.417923 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418060 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418195 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418402 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418498 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418665 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.418983 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.419161 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.419305 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.419472 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.419743 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.419842 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.25/identity {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420010 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420185 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420347 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420536 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420675 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420805 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.420971 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.421132 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.421311 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.421446 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.421619 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.421764 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422039 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422247 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422247 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422495 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422627 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422834 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.422834 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423207 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423207 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423455 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423455 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423697 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.423867 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424040 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424185 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424323 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424408 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424576 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424745 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.424916 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425087 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425242 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425410 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425560 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425723 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.425911 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426123 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426213 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426353 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426569 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426812 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.426812 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427042 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427285 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427454 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427635 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427798 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.427961 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428125 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428288 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428452 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428616 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428782 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.428948 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429112 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429280 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429442 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429605 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429767 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.429974 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430101 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430236 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430396 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430574 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430723 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.430898 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.431059 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.431386 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.431570 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.431734 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.431901 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432042 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432209 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432370 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432533 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432693 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.432857 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433017 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433155 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433303 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433479 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433642 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433806 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.433969 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434132 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434305 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434472 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434626 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434793 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.434958 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435111 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435271 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435446 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435635 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435802 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.435965 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436128 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436283 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436444 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436612 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436784 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.436955 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437120 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437293 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437464 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437636 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437787 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.437957 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438131 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438295 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438458 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438621 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438784 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.438947 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439095 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439265 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439419 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439590 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439735 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.439902 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440064 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440227 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440382 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440540 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440693 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.440852 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.441077 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.441221 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:33:18.441358 dv-cinder-786383-6-iscsi neutron-server[98286]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:33:18.513476 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52256) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:18.522414 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [-] 10.222.0.25 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0068285 May 25 15:33:29.109629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19d16f10-5820-4262-a8ab-872dee8fe22f None None] get_active_networks_info from dv-cinder-786383-6-iscsi {{(pid=98393) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} May 25 15:33:29.217643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19d16f10-5820-4262-a8ab-872dee8fe22f None None] No non-hosted networks {{(pid=98393) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 25 15:33:29.236437 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.agentschedulers_db [None req-19d16f10-5820-4262-a8ab-872dee8fe22f None None] DHCP Agent not found on host dv-cinder-786383-6-iscsi {{(pid=98393) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} May 25 15:33:29.310551 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-16a3813a-0829-4b5a-b8c6-148c6bc4ee0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:31.477277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:31.479385 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.480178 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.481378 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.482930 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.486864 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.488596 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.489446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.491721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.492244 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.493626 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.494986 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.495461 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:31.496539 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-786383-6-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:31.507286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-786383-6-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:33:31.679538 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7b5d748a-5d38-46ae-86af-08e12d9e86ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:31.731319 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ed1e2add-57c9-4b5f-8171-f6ee2bede624 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:32.650617 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:34.330080 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:35.711967 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52348) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:36.309536 dv-cinder-786383-6-iscsi neutron-server[98391]: WARNING oslo_policy.policy [None req-1d5145d9-a851-4934-ae80-6bfc05ae4b97 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:36.310138 dv-cinder-786383-6-iscsi neutron-server[98391]: WARNING oslo_policy.policy [None req-1d5145d9-a851-4934-ae80-6bfc05ae4b97 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:36.528440 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [None req-1d5145d9-a851-4934-ae80-6bfc05ae4b97 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98391) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:33:36.529639 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1d5145d9-a851-4934-ae80-6bfc05ae4b97 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8157184 May 25 15:33:38.647669 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.db.l3_hamode_db [None req-fa007600-783a-4565-b5b6-23d2573a5691 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 25 15:33:38.733547 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa007600-783a-4565-b5b6-23d2573a5691 None None] Routers set() bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:33:38.733933 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa007600-783a-4565-b5b6-23d2573a5691 None None] Router IDs set() for agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} May 25 15:33:38.850755 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52362) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:39.216292 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:33:39.314497 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.policy [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98391) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 15:33:39.360738 dv-cinder-786383-6-iscsi neutron-server[98391]: WARNING oslo_policy.policy [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:39.361115 dv-cinder-786383-6-iscsi neutron-server[98391]: WARNING oslo_policy.policy [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:39.370016 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.quota [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Loaded quota_driver: . May 25 15:33:39.385333 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:33:39.443189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482427752', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482428617', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482414764', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482444376', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482434771', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8792482330564', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1655700', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1699094', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-403200', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-575725'] for rbac-policy, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:39.503110 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:39.504329 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-63ee21df-95a9-43ea-99ab-dc52b896cd82 admin admin] 10.222.0.25 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6525979 May 25 15:33:42.029034 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52376) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:42.374036 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'name': 'private'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:33:42.378806 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:33:42.383872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Usage tracker for resource:network and tenant:076c6b1445c14cd180ca8d2632e53891 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:33:42.388368 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:33:42.394378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:33:42.403831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Made reservation on behalf of 076c6b1445c14cd180ca8d2632e53891 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:33:42.406733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.423725 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.437612 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:33:42.441154 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Usage tracker for resource:security_group_rule and tenant:076c6b1445c14cd180ca8d2632e53891 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:33:42.446501 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:33:42.451941 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:33:42.546205 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.549887 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.555562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:42.573402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] vlan segment allocate from pool success with {'vlan_id': 817, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:33:42.599029 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792484777957', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.599587 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Unsubscribe: segment precommit_create {{(pid=98391) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 15:33:42.600059 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Added segment 09bbbf02-52e7-4966-ba9a-319af66a66ec of type vlan for network a22453ca-0459-45df-9411-8ff67204abb7 May 25 15:33:42.647746 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19a8d489-9f11-4c17-b27d-e4e8bfc93d81,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:42.668198 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.668553 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.668882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.669202 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.669518 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.669847 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.670163 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.670475 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.670803 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.671120 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.671430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.671759 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Tracked resource versions report: May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: pushed versions: May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: { 'AddressGroup': {'1.2'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'ConntrackHelper': {'1.0'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Log': {'1.0'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Network': {'1.1'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Port': {'1.7'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'PortForwarding': {'1.2'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'QosPolicy': {'1.8'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroup': {'1.4'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroupRule': {'1.2'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SubPort': {'1.0'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Subnet': {'1.1'}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Trunk': {'1.1'}} May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: consumer versions: May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'ConntrackHelper': '1.0', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Log': '1.0', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Network': '1.1', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Port': '1.7', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'PortForwarding': '1.2', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'QosPolicy': '1.8', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroup': '1.4', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroupRule': '1.2', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SubPort': '1.0', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Subnet': '1.1', May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Trunk': '1.1'}} May 25 15:33:42.672837 dv-cinder-786383-6-iscsi neutron-server[98391]: {{(pid=98391) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:33:42.718759 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:42.720484 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.760163 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.761625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:33:42.762287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:42.766923 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:42.874815 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8335087 May 25 15:33:42.874815 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Pushing event updated for resources: {'Network': ['ID=a22453ca-0459-45df-9411-8ff67204abb7,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:42.874815 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:42.880910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network a22453ca-0459-45df-9411-8ff67204abb7 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:33:45.504867 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52392) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:46.075930 dv-cinder-786383-6-iscsi neutron-server[98392]: WARNING oslo_policy.policy [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:46.076501 dv-cinder-786383-6-iscsi neutron-server[98392]: WARNING oslo_policy.policy [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:46.509793 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.policy [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98392) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 15:33:46.553945 dv-cinder-786383-6-iscsi neutron-server[98392]: WARNING oslo_policy.policy [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:46.554321 dv-cinder-786383-6-iscsi neutron-server[98392]: WARNING oslo_policy.policy [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:33:46.562389 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:33:46.564091 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-35bb72c9-3614-4460-afab-6ba4ab3d4922 admin admin] 10.222.0.25 "GET /v2.0/networks/a22453ca-0459-45df-9411-8ff67204abb7 HTTP/1.1" status: 200 len: 825 time: 1.0583191 May 25 15:33:46.597085 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ed97393f-8693-4d4c-bbdc-77749c469763 admin admin] 10.222.0.25 "GET /v2.0/subnetpools/360d5e41-f9bb-4266-94bd-fedb3a776259 HTTP/1.1" status: 200 len: 734 time: 0.0271084 May 25 15:33:46.605455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Request body: {'subnet': {'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259', 'ip_version': 4, 'name': 'private-subnet', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'gateway_ip': '172.20.0.1'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:33:46.606990 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.quota [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Loaded quota_driver: . May 25 15:33:46.612909 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:33:46.618393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Usage tracker for resource:subnet and tenant:076c6b1445c14cd180ca8d2632e53891 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:33:46.621637 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:33:46.628450 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:33:46.644096 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Made reservation on behalf of 076c6b1445c14cd180ca8d2632e53891 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:33:46.647472 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:47.152027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:47.157592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:47.238346 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Checking segment: {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:33:47.238719 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Network hostable DHCP agents. Network: a22453ca-0459-45df-9411-8ff67204abb7, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:33:47.253424 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f3af2d68-8808-4ddb-949c-94fb14de14f0,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:47.262709 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.263063 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.263392 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.263739 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.264056 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.264395 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.264709 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.265017 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.265339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.265646 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.265952 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.266257 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Tracked resource versions report: May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: pushed versions: May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: { 'AddressGroup': {'1.2'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'ConntrackHelper': {'1.0'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Log': {'1.0'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Network': {'1.1'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Port': {'1.7'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'PortForwarding': {'1.2'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'QosPolicy': {'1.8'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroup': {'1.4'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroupRule': {'1.2'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SubPort': {'1.0'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Subnet': {'1.1'}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Trunk': {'1.1'}} May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: consumer versions: May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'ConntrackHelper': '1.0', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Log': '1.0', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Network': '1.1', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Port': '1.7', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'PortForwarding': '1.2', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'QosPolicy': '1.8', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroup': '1.4', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroupRule': '1.2', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SubPort': '1.0', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Subnet': '1.1', May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Trunk': '1.1'}} May 25 15:33:47.267327 dv-cinder-786383-6-iscsi neutron-server[98392]: {{(pid=98392) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:33:47.297716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Network a22453ca-0459-45df-9411-8ff67204abb7 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:33:47.301623 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:47.309368 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, a22453ca-0459-45df-9411-8ff67204abb7) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:33:47.313790 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:33:47.314441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:47.319078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0c63cfa-4b95-46d6-a4f8-e1d3e773f217 None None] Network a22453ca-0459-45df-9411-8ff67204abb7 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:33:47.334280 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7321718 May 25 15:33:47.624674 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-a22453ca-0459-45df-9411-8ff67204abb7', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:33:47.625896 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:47.807873 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Allocated IP 172.20.0.2 (a22453ca-0459-45df-9411-8ff67204abb7/f3af2d68-8808-4ddb-949c-94fb14de14f0/78e28570-27d9-4d9f-b696-dd02aff78058) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:33:48.036877 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:48.049461 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Transition to ACTIVE for port object 78e28570-27d9-4d9f-b696-dd02aff78058 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:33:48.068979 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Transition to ACTIVE for port object 78e28570-27d9-4d9f-b696-dd02aff78058 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:33:48.076049 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:48.081576 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:48.138952 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Network a22453ca-0459-45df-9411-8ff67204abb7 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:33:48.141817 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:33:48.148569 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:33:48.157687 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Pushing event updated for resources: {'Port': ['ID=78e28570-27d9-4d9f-b696-dd02aff78058,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:48.199764 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.200102 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.200432 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.200759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.201081 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.201402 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.201719 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.202034 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.202369 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.202687 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.203000 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.203309 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Tracked resource versions report: May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: pushed versions: May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: { 'AddressGroup': {'1.2'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'ConntrackHelper': {'1.0'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Log': {'1.0'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Network': {'1.1'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Port': {'1.7'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'PortForwarding': {'1.2'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'QosPolicy': {'1.8'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroup': {'1.4'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroupRule': {'1.2'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SubPort': {'1.0'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Subnet': {'1.1'}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Trunk': {'1.1'}} May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: consumer versions: May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'ConntrackHelper': '1.0', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Log': '1.0', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Network': '1.1', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Port': '1.7', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'PortForwarding': '1.2', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'QosPolicy': '1.8', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroup': '1.4', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroupRule': '1.2', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SubPort': '1.0', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Subnet': '1.1', May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Trunk': '1.1'}} May 25 15:33:48.204446 dv-cinder-786383-6-iscsi neutron-server[98393]: {{(pid=98393) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:33:48.236121 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:48.255320 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Attempting to bind port 78e28570-27d9-4d9f-b696-dd02aff78058 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:33:48.256261 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Attempting to bind port 78e28570-27d9-4d9f-b696-dd02aff78058 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:33:48.256715 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Attempting to bind port 78e28570-27d9-4d9f-b696-dd02aff78058 on network a22453ca-0459-45df-9411-8ff67204abb7 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:33:48.261797 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 33, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:33:48.262203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Checking segment: {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:33:48.262690 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:48.263082 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Bound using segment: {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:33:48.263629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Bound port: 78e28570-27d9-4d9f-b696-dd02aff78058, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:33:48.264003 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:48.352099 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] For port 78e28570-27d9-4d9f-b696-dd02aff78058, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:33:48.355920 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] For port 78e28570-27d9-4d9f-b696-dd02aff78058, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=78e28570-27d9-4d9f-b696-dd02aff78058,segment=NetworkSegment(09bbbf02-52e7-4966-ba9a-319af66a66ec),segment_id=09bbbf02-52e7-4966-ba9a-319af66a66ec)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:33:48.360386 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:48.365465 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:48.448351 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Pushing event updated for resources: {'Port': ['ID=78e28570-27d9-4d9f-b696-dd02aff78058,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:48.470051 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:49.679097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52414) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:50.047318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [None req-f9fc4bc5-dc4b-4b1a-8879-a520f673f501 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:33:50.048437 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f9fc4bc5-dc4b-4b1a-8879-a520f673f501 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3683658 May 25 15:33:52.392854 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52424) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:52.770509 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [None req-317408fb-0159-47db-bf37-32ff8bcc49f4 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:33:52.771567 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-317408fb-0159-47db-bf37-32ff8bcc49f4 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3777921 May 25 15:33:53.556125 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 78e28570-27d9-4d9f-b696-dd02aff78058 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:33:53.634722 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 78e28570-27d9-4d9f-b696-dd02aff78058 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:33:53.963251 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae47e2c7-ca03-4be9-97e7-88ff38d6695f None None] Network a22453ca-0459-45df-9411-8ff67204abb7 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:33:54.087083 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Provisioning for port 78e28570-27d9-4d9f-b696-dd02aff78058 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:33:54.097590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Provisioning complete for port 78e28570-27d9-4d9f-b696-dd02aff78058 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:33:54.097988 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:54.303101 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:54.342962 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] For port 78e28570-27d9-4d9f-b696-dd02aff78058, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=78e28570-27d9-4d9f-b696-dd02aff78058,segment=NetworkSegment(09bbbf02-52e7-4966-ba9a-319af66a66ec),segment_id=09bbbf02-52e7-4966-ba9a-319af66a66ec)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:33:54.346609 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:54.348552 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:33:54.416345 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Pushing event updated for resources: {'Port': ['ID=78e28570-27d9-4d9f-b696-dd02aff78058,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:33:54.419961 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:33:54.567143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-17e758ce-b198-4a1f-a2ff-7042e9d31ee6 None None] Provisioning complete for port 78e28570-27d9-4d9f-b696-dd02aff78058 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:33:54.567791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-17e758ce-b198-4a1f-a2ff-7042e9d31ee6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.379719 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52440) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:55.523814 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 78e28570-27d9-4d9f-b696-dd02aff78058 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:33:55.610332 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 78e28570-27d9-4d9f-b696-dd02aff78058 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:33:55.610936 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.739671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'name': 'router1'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:33:55.745103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:33:55.748797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Usage tracker for resource:router and tenant:076c6b1445c14cd180ca8d2632e53891 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:33:55.752050 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:33:55.757745 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:33:55.767947 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.769485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.792871 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.901914 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.920317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.921459 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6b72c7f8-0bc8-4743-b33b-af3402f25dab admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5408018 May 25 15:33:58.212492 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52450) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:33:58.572879 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [None req-03c7a8f3-9d2c-499e-983b-4cca35c1113c admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:33:58.573842 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-03c7a8f3-9d2c-499e-983b-4cca35c1113c admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3604379 May 25 15:33:59.053484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a9373fa2-e90f-4d44-8d3c-c5b7d58d3a42 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:00.899282 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52460) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:01.260258 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'name': 'public', 'provider:network_type': 'flat', 'admin_state_up': True, 'router:external': True, 'is_default': True}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:34:01.264735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:34:01.268370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Usage tracker for resource:network and tenant:2995e1ac2fd14a59a491d3088bc7fb64 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:34:01.271276 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:34:01.277315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:34:01.286672 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Made reservation on behalf of 2995e1ac2fd14a59a491d3088bc7fb64 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:34:01.288918 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.300114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.314140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:34:01.317707 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Usage tracker for resource:security_group_rule and tenant:2995e1ac2fd14a59a491d3088bc7fb64 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:34:01.320961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:34:01.326376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:34:01.405663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.410039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.413984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:01.426300 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Reserving flat network on physical network physnet1 {{(pid=98391) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 25 15:34:01.449653 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4606d594-0adb-458a-94ea-134453fab621,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:01.453458 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:01.454377 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.454720 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Added segment 9413c02f-d8ea-4438-b174-b54dd38bccfe of type flat for network dd24df8c-53ac-4808-8523-828ba13af2df May 25 15:34:01.470488 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.494049 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.530618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.531909 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:01.532469 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:01.536871 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:01.629292 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7288930 May 25 15:34:01.631842 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Pushing event updated for resources: {'Network': ['ID=dd24df8c-53ac-4808-8523-828ba13af2df,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:01.634586 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:01.645288 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network dd24df8c-53ac-4808-8523-828ba13af2df details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:34:01.668054 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4f20b0e7-ba35-48af-8781-4990f1cd437f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:02.603519 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:03.922539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52480) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:04.134409 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5305859-9eba-4c5e-a9e3-0a1302ad0c3f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:04.135751 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e5305859-9eba-4c5e-a9e3-0a1302ad0c3f admin admin] 10.222.0.25 "GET /v2.0/subnets/f3af2d68-8808-4ddb-949c-94fb14de14f0 HTTP/1.1" status: 200 len: 849 time: 0.2122569 May 25 15:34:04.285129 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:04.323326 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6c02d2b2-56dd-46f2-bfda-5d6ba2cafae7 admin admin] 10.222.0.25 "GET /v2.0/routers/fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 HTTP/1.1" status: 200 len: 704 time: 0.1818845 May 25 15:34:04.333735 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:34:04.782356 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.006531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Allocated IP 172.20.0.1 (a22453ca-0459-45df-9411-8ff67204abb7/f3af2d68-8808-4ddb-949c-94fb14de14f0/1aacf025-c10c-49a1-b71f-ad1fe8f19735) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:34:05.157674 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.174728 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Transition to ACTIVE for port object 1aacf025-c10c-49a1-b71f-ad1fe8f19735 will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:34:05.228351 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.232749 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:05.292527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Network a22453ca-0459-45df-9411-8ff67204abb7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:34:05.295326 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:34:05.301716 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:34:05.302248 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.436619 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Pushing event updated for resources: {'Port': ['ID=1aacf025-c10c-49a1-b71f-ad1fe8f19735,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:05.448038 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:05.460920 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-1514ae2b-b47f-4a77-bd98-9b3386b74cd7 None None] Provisioning for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:34:05.465323 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-1514ae2b-b47f-4a77-bd98-9b3386b74cd7 None None] Provisioning complete for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:05.465691 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1514ae2b-b47f-4a77-bd98-9b3386b74cd7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.517779 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-1514ae2b-b47f-4a77-bd98-9b3386b74cd7 None None] Port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:34:05.602468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.822820 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.827318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.828416 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.832331 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:05.962153 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Pushing event updated for resources: {'Port': ['ID=1aacf025-c10c-49a1-b71f-ad1fe8f19735,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:05.966656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:06.022451 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Network a22453ca-0459-45df-9411-8ff67204abb7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:34:06.023494 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:34:06.205015 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:34:06.239580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-45c043a9-4417-4e34-b9ac-343a19e05141 None None] Provisioning complete for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:06.239877 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-45c043a9-4417-4e34-b9ac-343a19e05141 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:06.294245 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-45c043a9-4417-4e34-b9ac-343a19e05141 None None] Port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:34:06.359891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:34:06.369116 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] 10.222.0.25 "PUT /v2.0/routers/fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0410774 May 25 15:34:06.369716 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Sync routers for ids ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:34:06.379789 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Routers {'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:34:06.380634 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:34:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:06.549948 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Set router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:34:06.911458 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:05Z', 'revision_number': 2, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port_host': None, '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:05Z', 'revision_number': 2, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:06.916808 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Checking router: fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:34:06.917177 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Updating router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:34:06.971291 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.346775 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.361045 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Transition to ACTIVE for port object 1aacf025-c10c-49a1-b71f-ad1fe8f19735 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:34:07.368318 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.374857 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:07.583459 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Pushing event updated for resources: {'Port': ['ID=1aacf025-c10c-49a1-b71f-ad1fe8f19735,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:07.598581 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.598825 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.599131 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.599445 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.600370 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.600685 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.600999 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.601308 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.601691 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.601997 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.602302 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.602604 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Tracked resource versions report: May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: pushed versions: May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: { 'AddressGroup': {'1.2'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'ConntrackHelper': {'1.0'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Log': {'1.0'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Network': {'1.1'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Port': {'1.7'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'PortForwarding': {'1.2'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'QosPolicy': {'1.8'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroup': {'1.4'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroupRule': {'1.2'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SubPort': {'1.0'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Subnet': {'1.1'}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Trunk': {'1.1'}} May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: consumer versions: May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'ConntrackHelper': '1.0', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Log': '1.0', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Network': '1.1', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Port': '1.7', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'PortForwarding': '1.2', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'QosPolicy': '1.8', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroup': '1.4', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroupRule': '1.2', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SubPort': '1.0', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Subnet': '1.1', May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Trunk': '1.1'}} May 25 15:34:07.603716 dv-cinder-786383-6-iscsi neutron-server[98394]: {{(pid=98394) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:34:07.612377 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Attempting to bind port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:34:07.612774 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Attempting to bind port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:34:07.613206 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Attempting to bind port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 on network a22453ca-0459-45df-9411-8ff67204abb7 {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:34:07.615383 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:07.619735 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 34, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:34:07.620138 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Checking segment: {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:34:07.620611 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.620995 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Bound using segment: {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:34:07.621515 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Bound port: 1aacf025-c10c-49a1-b71f-ad1fe8f19735, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09bbbf02-52e7-4966-ba9a-319af66a66ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:34:07.621907 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.712998 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] For port 1aacf025-c10c-49a1-b71f-ad1fe8f19735, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:34:07.718636 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] For port 1aacf025-c10c-49a1-b71f-ad1fe8f19735, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1aacf025-c10c-49a1-b71f-ad1fe8f19735,segment=NetworkSegment(09bbbf02-52e7-4966-ba9a-319af66a66ec),segment_id=09bbbf02-52e7-4966-ba9a-319af66a66ec)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:34:07.722817 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:07.727238 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:07.816140 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Routers {'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:34:07.816848 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:34:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:07.872194 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Pushing event updated for resources: {'Port': ['ID=1aacf025-c10c-49a1-b71f-ad1fe8f19735,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:07.882485 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:07.998942 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] Set router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:34:08.323000 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:05Z', 'revision_number': 2, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port_host': None, '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:07Z', 'revision_number': 4, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:08.326804 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4d7d151-8a30-4038-a317-0167a2f8dfaf None None] The sync data for ids ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'] in dv-cinder-786383-6-iscsi is: [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:05Z', 'revision_number': 2, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port_host': None, '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:07Z', 'revision_number': 4, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:34:08.564676 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52502) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:08.711217 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1761d8d1-4ae2-4670-ba40-26f8fd1cfe75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:08.711792 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-1761d8d1-4ae2-4670-ba40-26f8fd1cfe75 admin admin] Synchronizing usage tracker for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:network {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:34:08.730130 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-1761d8d1-4ae2-4670-ba40-26f8fd1cfe75 admin admin] Unset dirty status for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:network {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:34:08.731280 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1761d8d1-4ae2-4670-ba40-26f8fd1cfe75 admin admin] 10.222.0.25 "GET /v2.0/networks/dd24df8c-53ac-4808-8523-828ba13af2df HTTP/1.1" status: 200 len: 842 time: 0.1656761 May 25 15:34:08.740439 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Request body: {'subnet': {'gateway_ip': '172.27.1.1', 'ip_version': 4, 'cidr': '172.27.1.0/24', 'enable_dhcp': False, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'name': 'public-subnet'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:34:08.745401 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:34:08.749066 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Usage tracker for resource:subnet and tenant:2995e1ac2fd14a59a491d3088bc7fb64 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:34:08.751972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:34:08.758034 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:34:08.769674 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Made reservation on behalf of 2995e1ac2fd14a59a491d3088bc7fb64 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:34:08.772813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:09.187870 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.objects.ports [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=98391) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} May 25 15:34:09.188316 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:09.193339 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:09.263157 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Pushing event updated for resources: {'Subnet': ['ID=719fe799-49f6-4160-98fd-c7cb57ccb76d,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:09.267394 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:34:09.267777 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Network hostable DHCP agents. Network: dd24df8c-53ac-4808-8523-828ba13af2df, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:34:09.270476 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:09.286860 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:34:09.296385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, dd24df8c-53ac-4808-8523-828ba13af2df) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:34:09.300232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:09.300806 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:09.309559 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2799de94-71b4-4aa7-b056-a772927df61c None None] Network dd24df8c-53ac-4808-8523-828ba13af2df requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:34:09.325987 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5889523 May 25 15:34:09.518154 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b23f276-3c99-465c-b86b-0c648e827ae8 None None] Network dd24df8c-53ac-4808-8523-828ba13af2df requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:34:11.535461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52516) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:11.554388 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1aacf025-c10c-49a1-b71f-ad1fe8f19735 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:34:11.624117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:34:11.628794 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:11.629196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:11.752075 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:11.783440 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 1aacf025-c10c-49a1-b71f-ad1fe8f19735, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1aacf025-c10c-49a1-b71f-ad1fe8f19735,segment=NetworkSegment(09bbbf02-52e7-4966-ba9a-319af66a66ec),segment_id=09bbbf02-52e7-4966-ba9a-319af66a66ec)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:34:11.788759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:11.792117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:11.807180 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-56f2aab5-413e-4b15-b70b-f0ebd2fe3f3b admin admin] 10.222.0.25 "GET /v2.0/routers/fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 HTTP/1.1" status: 200 len: 710 time: 0.2705016 May 25 15:34:11.860677 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=1aacf025-c10c-49a1-b71f-ad1fe8f19735,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:11.863909 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:11.937296 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfe2443c-a2cf-4fd4-a31c-ad1ed8003bfb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:11.938644 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-dfe2443c-a2cf-4fd4-a31c-ad1ed8003bfb admin admin] 10.222.0.25 "GET /v2.0/networks/dd24df8c-53ac-4808-8523-828ba13af2df HTTP/1.1" status: 200 len: 886 time: 0.1248591 May 25 15:34:11.947299 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:34:12.389063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:12.713829 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:12.767862 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:12.935390 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Allocated IP 172.27.1.41 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/fe69ab1e-b83f-4eb1-8425-3eeabd67e26f) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:34:13.071972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:13.099996 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:13.104336 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:13.162949 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:34:13.165673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:34:13.171523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:34:13.219449 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Pushing event updated for resources: {'Port': ['ID=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:13.227448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:13.535339 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1aacf025-c10c-49a1-b71f-ad1fe8f19735 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:34:13.544837 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:13.601530 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:13.601904 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:13.877854 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:13.881673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-408233', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-408296', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-406396'] for router, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:14.057286 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:34:14.279143 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:34:14.287525 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:14.289598 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] 10.222.0.25 "PUT /v2.0/routers/fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 HTTP/1.1" status: 200 len: 889 time: 2.3446407 May 25 15:34:14.289744 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Sync routers for ids ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:34:14.299186 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Routers {'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:34:14.300011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:34:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:14.511287 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Set router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:34:14.848407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:13Z', 'revision_number': 4, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port': {'id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:72:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:12Z', 'updated_at': '2021-05-25T15:34:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:11Z', 'revision_number': 5, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:14.853233 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Checking router: fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:34:14.853589 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Updating router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:34:14.904066 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.223925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.235731 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Transition to ACTIVE for port object fe69ab1e-b83f-4eb1-8425-3eeabd67e26f will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:34:15.242333 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.246133 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f9bace86-a2dd-468e-8f2d-6c36102824db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:15.323777 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Pushing event updated for resources: {'Port': ['ID=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:15.326093 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Attempting to bind port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:34:15.326466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Attempting to bind port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:34:15.326824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Attempting to bind port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:34:15.330238 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:15.332634 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 34, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:34:15.333008 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:34:15.333410 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.333825 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:34:15.334509 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Bound port: fe69ab1e-b83f-4eb1-8425-3eeabd67e26f, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:34:15.335106 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.419116 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] For port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:34:15.422791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] For port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:34:15.426756 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:15.430476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:15.506658 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Routers {'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:34:15.507284 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:34:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:15.570044 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Pushing event updated for resources: {'Port': ['ID=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:15.581426 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:15.693268 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] Set router fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:34:16.043616 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:13Z', 'revision_number': 4, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port': {'id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:72:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:12Z', 'updated_at': '2021-05-25T15:34:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:11Z', 'revision_number': 5, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:34:16.047806 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c03cb39a-b5a7-4a79-96c0-f83f817c84da None None] The sync data for ids ['fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1'] in dv-cinder-786383-6-iscsi is: [{'id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'name': 'router1', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:33:55Z', 'updated_at': '2021-05-25T15:34:13Z', 'revision_number': 4, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'gw_port': {'id': 'fe69ab1e-b83f-4eb1-8425-3eeabd67e26f', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:72:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:12Z', 'updated_at': '2021-05-25T15:34:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '1aacf025-c10c-49a1-b71f-ad1fe8f19735', 'name': '', 'network_id': 'a22453ca-0459-45df-9411-8ff67204abb7', 'tenant_id': '076c6b1445c14cd180ca8d2632e53891', 'mac_address': 'fa:16:3e:b6:97:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed3ed1d-2c7a-48e9-9602-893dc3aa7ee1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:34:04Z', 'updated_at': '2021-05-25T15:34:11Z', 'revision_number': 5, 'project_id': '076c6b1445c14cd180ca8d2632e53891', 'subnets': [{'id': 'f3af2d68-8808-4ddb-949c-94fb14de14f0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '360d5e41-f9bb-4266-94bd-fedb3a776259'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:34:16.609798 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52526) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:16.726436 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-82949272-cd45-49bb-a109-bd8d43640be6 admin admin] 10.222.0.25 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1155202 May 25 15:34:17.583266 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device fe69ab1e-b83f-4eb1-8425-3eeabd67e26f up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:34:17.656761 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:34:17.661206 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:17.661580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:17.775205 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:17.792773 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:34:17.797670 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:17.799728 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:17.865668 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=fe69ab1e-b83f-4eb1-8425-3eeabd67e26f,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:17.868672 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:19.566372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device fe69ab1e-b83f-4eb1-8425-3eeabd67e26f up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:34:19.663610 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port fe69ab1e-b83f-4eb1-8425-3eeabd67e26f triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:19.664315 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:29.058331 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f740dff4-5b66-478c-84d7-8264061b1669 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:31.534335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:31.658568 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34922a79-e18a-4479-ae74-937687a6e207 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:32.633145 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:34.313607 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:41.333005 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:34:59.065341 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d9f70835-5e73-4351-bb29-0ddf1a863a06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:01.473910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:01.659428 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c1f00e54-b5d1-4821-a988-b432c7db7f9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:02.611153 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:04.314404 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:18.333093 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:35:29.060734 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-13be8c4f-24f5-48c3-8a40-5f99a78838db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:31.472457 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:31.643286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ece99b12-3ced-41ea-931d-809374409c5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:32.612848 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:34.315416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:52.564301 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53096) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:52.629850 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.pecan_wsgi.hooks.translation [None req-fcec333c-e94c-4b41-be44-1f9891e572cc admin admin] GET failed (client error): The resource could not be found. May 25 15:35:52.631069 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-fcec333c-e94c-4b41-be44-1f9891e572cc admin admin] 10.222.0.25 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0658295 May 25 15:35:52.760901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5213ff10-624f-4762-84ce-254658b61c10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:52.762529 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-5213ff10-624f-4762-84ce-254658b61c10 admin admin] 10.222.0.25 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1276727 May 25 15:35:54.859277 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53106) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:54.963663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9301049-b909-4c3d-982f-b13f15adb61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:54.964477 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a9301049-b909-4c3d-982f-b13f15adb61a admin admin] Synchronizing usage tracker for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:subnet {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:35:54.979096 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a9301049-b909-4c3d-982f-b13f15adb61a admin admin] Unset dirty status for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:subnet {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:35:54.980222 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-a9301049-b909-4c3d-982f-b13f15adb61a admin admin] 10.222.0.25 "GET /v2.0/subnets/f3af2d68-8808-4ddb-949c-94fb14de14f0 HTTP/1.1" status: 200 len: 849 time: 0.1199939 May 25 15:35:54.989435 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:35:55.103437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Notify callbacks [] for subnet, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:55.284032 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8792484766877'] for subnet, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:55.288279 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:55.326214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:55.326803 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:55.333336 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] 10.222.0.25 "PUT /v2.0/subnets/f3af2d68-8808-4ddb-949c-94fb14de14f0 HTTP/1.1" status: 200 len: 868 time: 0.3423967 May 25 15:35:55.333469 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:35:55.347216 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59e5fc9b-3d34-4c2f-8a51-f286386619e1 None None] Network a22453ca-0459-45df-9411-8ff67204abb7 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:35:55.357637 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f3af2d68-8808-4ddb-949c-94fb14de14f0,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:55.365300 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.365665 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.366003 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.366331 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.366657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.367046 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.367380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.367733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.368076 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.368398 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.368714 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.369028 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:55.372615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:55.767188 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-1eb43345-2af0-46f8-8b2d-70f4834c9a0a None None] Provisioning complete for port 78e28570-27d9-4d9f-b696-dd02aff78058 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:35:55.767574 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1eb43345-2af0-46f8-8b2d-70f4834c9a0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:55.897015 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-1eb43345-2af0-46f8-8b2d-70f4834c9a0a None None] Provisioning complete for port 1aacf025-c10c-49a1-b71f-ad1fe8f19735 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:35:55.897416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1eb43345-2af0-46f8-8b2d-70f4834c9a0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:57.419229 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53116) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:57.589403 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c176beff-c316-4a1a-a738-82a5841e6768 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:57.589893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c176beff-c316-4a1a-a738-82a5841e6768 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:57.591400 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c176beff-c316-4a1a-a738-82a5841e6768 admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1711831 May 25 15:35:59.062735 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c888bbcb-243f-4cf5-9899-e820cbe5516b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:59.698535 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53126) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:59.867158 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32d8e256-7056-434d-8035-a166cb76b77b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:59.867533 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32d8e256-7056-434d-8035-a166cb76b77b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:59.869039 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-32d8e256-7056-434d-8035-a166cb76b77b admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1695659 May 25 15:36:01.469607 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:01.648201 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7f9c4a46-1caf-4a02-acd7-7ff3669e9d98 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:01.966139 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53136) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:02.131372 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-769b7400-b735-4559-a28f-f0833857beb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:02.133224 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-769b7400-b735-4559-a28f-f0833857beb3 admin admin] 10.222.0.25 "GET /v2.0/networks/a22453ca-0459-45df-9411-8ff67204abb7 HTTP/1.1" status: 200 len: 869 time: 0.1656544 May 25 15:36:02.613364 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:04.241661 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53146) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:04.318638 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:04.406845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94d74897-a3d9-4abc-bf5d-db9df2f93c82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:04.408198 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-94d74897-a3d9-4abc-bf5d-db9df2f93c82 admin admin] 10.222.0.25 "GET /v2.0/networks/dd24df8c-53ac-4808-8523-828ba13af2df HTTP/1.1" status: 200 len: 886 time: 0.1655953 May 25 15:36:06.534111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53156) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:06.639276 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c15d6b62-403e-4c56-8aec-92c526059185 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:06.639831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c15d6b62-403e-4c56-8aec-92c526059185 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:06.641317 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c15d6b62-403e-4c56-8aec-92c526059185 admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1062703 May 25 15:36:08.757396 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53166) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:08.864601 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bca68ec-b94e-4709-81c5-8a0e1a8b62e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:08.865068 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bca68ec-b94e-4709-81c5-8a0e1a8b62e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:08.866523 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3bca68ec-b94e-4709-81c5-8a0e1a8b62e8 admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1081994 May 25 15:36:10.997231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53176) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:11.095324 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ee54b9-f309-4080-b7e6-cd23806455ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:11.096673 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-42ee54b9-f309-4080-b7e6-cd23806455ef admin admin] 10.222.0.25 "GET /v2.0/subnets/719fe799-49f6-4160-98fd-c7cb57ccb76d HTTP/1.1" status: 200 len: 816 time: 0.0984755 May 25 15:36:13.236065 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53186) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:13.339986 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47c8e04f-101d-4029-a3cd-7cab9838c681 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:13.341302 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-47c8e04f-101d-4029-a3cd-7cab9838c681 admin admin] 10.222.0.25 "GET /v2.0/subnets/f3af2d68-8808-4ddb-949c-94fb14de14f0 HTTP/1.1" status: 200 len: 868 time: 0.1042471 May 25 15:36:29.065025 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a5f0e501-f9ec-4646-8033-7ef35b5833ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:31.471945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:31.649570 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-71f63bc3-cf7b-4d89-9994-22b4d30e740a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:32.330719 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:36:32.616919 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:34.322412 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:36.102445 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53230) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:36.150571 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [None req-e339e3b1-ff1b-4cc1-8a22-57bd795f023b admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98391) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:36:36.151617 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e339e3b1-ff1b-4cc1-8a22-57bd795f023b admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0482242 May 25 15:36:38.317083 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53240) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:38.385243 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.pecan_wsgi.hooks.translation [None req-598850fe-fe27-40ba-8992-6d62ff98ad54 admin admin] GET failed (client error): The resource could not be found. May 25 15:36:38.386467 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-598850fe-fe27-40ba-8992-6d62ff98ad54 admin admin] 10.222.0.25 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0684309 May 25 15:36:38.551690 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bad3a706-7af4-4d5b-9837-d1557b2905b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:38.553164 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-bad3a706-7af4-4d5b-9837-d1557b2905b0 admin admin] 10.222.0.25 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1629484 May 25 15:36:40.666346 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53250) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:40.713230 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:36:40.717657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:36:40.727578 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:36:40.736904 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Made reservation on behalf of 2995e1ac2fd14a59a491d3088bc7fb64 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:36:40.739408 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:40.825059 dv-cinder-786383-6-iscsi neutron-server[98391]: WARNING neutron.services.revisions.revision_plugin [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Could not find related network for resource to bump revision. May 25 15:36:40.836389 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] vlan segment allocate from pool success with {'vlan_id': 810, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:36:40.845204 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:40.845479 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Added segment e59bb930-6f45-4068-949e-e382d6e561f0 of type vlan for network b9eb3a46-b38b-4466-b035-073a858cfd39 May 25 15:36:40.869898 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:40.897721 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:40.898976 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:40.899537 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:40.903930 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:40.994380 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3269598 May 25 15:36:40.999172 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Pushing event updated for resources: {'Network': ['ID=b9eb3a46-b38b-4466-b035-073a858cfd39,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:41.002059 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:41.010704 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network b9eb3a46-b38b-4466-b035-073a858cfd39 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:36:43.108042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53260) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:43.197216 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.pecan_wsgi.hooks.translation [None req-0d6287c4-eba5-4e50-bdc1-3c735799d90e admin admin] GET failed (client error): The resource could not be found. May 25 15:36:43.198479 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-0d6287c4-eba5-4e50-bdc1-3c735799d90e admin admin] 10.222.0.25 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0895355 May 25 15:36:43.300743 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-262c866d-5059-4792-819a-55a83590a0ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:43.302641 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-262c866d-5059-4792-819a-55a83590a0ba admin admin] 10.222.0.25 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1003606 May 25 15:36:43.311933 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Request body: {'subnet': {'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4, 'name': 'shared-subnet'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:36:43.316149 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:36:43.325334 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:36:43.335329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Made reservation on behalf of 2995e1ac2fd14a59a491d3088bc7fb64 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:36:43.337772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:43.695971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:43.700300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-71ab1c48-4324-4b75-9a51-6964b891bf48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:43.772475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dbd03780-5c02-4fbd-82c5-313c0ebd02fc,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:43.779673 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Checking segment: {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:36:43.780017 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Network hostable DHCP agents. Network: b9eb3a46-b38b-4466-b035-073a858cfd39, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:36:43.783920 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.784272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.784601 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.784921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.785234 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.785550 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.786413 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.786728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.787045 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.787353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.787682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.787990 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:43.794778 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:43.803259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Network b9eb3a46-b38b-4466-b035-073a858cfd39 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:36:43.811913 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, b9eb3a46-b38b-4466-b035-073a858cfd39) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:36:43.815610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:36:43.816204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:43.821185 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd40562c-4d1b-4bbe-b009-5bf4378f8c4b None None] Network b9eb3a46-b38b-4466-b035-073a858cfd39 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:36:43.840426 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5317004 May 25 15:36:44.066007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-b9eb3a46-b38b-4466-b035-073a858cfd39', 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39', 'tenant_id': '2995e1ac2fd14a59a491d3088bc7fb64', 'fixed_ips': [{'subnet_id': 'dbd03780-5c02-4fbd-82c5-313c0ebd02fc'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:36:44.066840 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.222616 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Allocated IP 192.168.233.2 (b9eb3a46-b38b-4466-b035-073a858cfd39/dbd03780-5c02-4fbd-82c5-313c0ebd02fc/9496dbf7-2248-4326-8ef4-5fbaad312b87) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:36:44.424985 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.436257 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Transition to ACTIVE for port object 9496dbf7-2248-4326-8ef4-5fbaad312b87 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:36:44.455283 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Transition to ACTIVE for port object 9496dbf7-2248-4326-8ef4-5fbaad312b87 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:36:44.461692 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.468442 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:44.537807 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Network b9eb3a46-b38b-4466-b035-073a858cfd39 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:36:44.542800 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:36:44.545303 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:36:44.553653 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Pushing event updated for resources: {'Port': ['ID=9496dbf7-2248-4326-8ef4-5fbaad312b87,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:44.590092 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.590443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.590766 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.591094 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.591416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.591767 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.592092 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.592416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.592750 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.593072 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.593404 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.593721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:44.597416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:44.652935 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Attempting to bind port 9496dbf7-2248-4326-8ef4-5fbaad312b87 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:36:44.653297 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Attempting to bind port 9496dbf7-2248-4326-8ef4-5fbaad312b87 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:36:44.653659 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Attempting to bind port 9496dbf7-2248-4326-8ef4-5fbaad312b87 on network b9eb3a46-b38b-4466-b035-073a858cfd39 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:36:44.658967 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 36, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:36:44.659335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Checking segment: {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:36:44.659766 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.660159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Bound using segment: {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:36:44.660626 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Bound port: 9496dbf7-2248-4326-8ef4-5fbaad312b87, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:36:44.661506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.747827 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] For port 9496dbf7-2248-4326-8ef4-5fbaad312b87, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:36:44.750770 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] For port 9496dbf7-2248-4326-8ef4-5fbaad312b87, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9496dbf7-2248-4326-8ef4-5fbaad312b87,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:36:44.756149 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:44.759997 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-77a65797-3374-4ea1-a3f9-7967dcde7d6e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:44.835342 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Pushing event updated for resources: {'Port': ['ID=9496dbf7-2248-4326-8ef4-5fbaad312b87,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:44.838614 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:45.602626 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07478a08-7247-4b8f-a187-870993237324 None None] Network b9eb3a46-b38b-4466-b035-073a858cfd39 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:36:45.694746 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9496dbf7-2248-4326-8ef4-5fbaad312b87 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:36:45.736371 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-52c9e7b2-251c-4ae0-912a-977361a385c6 None None] Provisioning for port 9496dbf7-2248-4326-8ef4-5fbaad312b87 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:36:45.849733 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 9496dbf7-2248-4326-8ef4-5fbaad312b87 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:36:45.857187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 9496dbf7-2248-4326-8ef4-5fbaad312b87 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:36:45.857563 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:46.023361 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:46.057986 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 9496dbf7-2248-4326-8ef4-5fbaad312b87, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9496dbf7-2248-4326-8ef4-5fbaad312b87,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:36:46.064440 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:46.066228 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:46.136652 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=9496dbf7-2248-4326-8ef4-5fbaad312b87,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:46.139768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:46.188313 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-22e04460-7a78-4489-b272-ff2e80d781b7 None None] Provisioning complete for port 9496dbf7-2248-4326-8ef4-5fbaad312b87 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:36:46.188681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-22e04460-7a78-4489-b272-ff2e80d781b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:47.648656 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9496dbf7-2248-4326-8ef4-5fbaad312b87 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:36:47.738445 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 9496dbf7-2248-4326-8ef4-5fbaad312b87 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:36:47.739396 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:59.066892 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c00d1b17-ac02-4f35-b71f-c0e4c8615580 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:01.475478 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:01.651139 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3ceddfe-565f-42ec-94de-6211425094a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:02.619205 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:04.323523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:09.329031 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:37:29.070474 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-61687949-4447-4e94-a985-cbceb53a776d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:31.477039 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:31.652577 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-867be582-4d6a-427f-8040-c670b0780061 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:32.622624 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:34.326475 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:46.328020 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:37:53.725092 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53312) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:37:53.731099 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [None req-561be2fa-fada-4385-9f5a-b957a28d0fce tempest-verify_tempest_config-1846726126 tempest-verify_tempest_config-1846726126-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98391) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:37:53.732088 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-561be2fa-fada-4385-9f5a-b957a28d0fce tempest-verify_tempest_config-1846726126 tempest-verify_tempest_config-1846726126-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0060291 May 25 15:37:54.033673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53330) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:37:54.146836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.160973 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:37:54.164809 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Usage tracker for resource:security_group_rule and tenant:8a551b65c47b450fb43bd110838c74d7 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:37:54.167665 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:37:54.173852 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:37:54.255056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.258674 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.267361 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:37:54.304169 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Synchronizing usage tracker for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:security_group {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:37:54.307365 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42c3164a-e418-48d7-9ed7-ac1b30ad29a2,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:37:54.317182 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.317542 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.317882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.318211 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.318533 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.318858 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.319180 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.319498 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.319861 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.320180 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.320492 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.320804 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:37:54.324447 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:37:54.334931 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Unset dirty status for tenant:2995e1ac2fd14a59a491d3088bc7fb64 on resource:security_group {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:37:54.336215 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8a551b65c47b450fb43bd110838c74d7&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3015757 May 25 15:37:54.338874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53336) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:37:54.397082 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.421453 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.519092 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.522813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:37:54.533894 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42c3164a-e418-48d7-9ed7-ac1b30ad29a2,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:37:54.536076 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:37:54.540763 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:54.541844 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/42c3164a-e418-48d7-9ed7-ac1b30ad29a2 HTTP/1.1" status: 204 len: 168 time: 0.2020946 May 25 15:37:59.073848 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8ca0f32d-1dc2-4cc4-8e95-84099961a8a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:01.478016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:01.656696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1b73bfa4-4c06-4fec-99de-0a2b70187761 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:02.625346 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:04.329373 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:23.326678 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:38:29.076038 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7ddad980-6b59-42d0-8682-911b147956dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:31.480010 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:31.657875 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-08476dc3-b6ec-47f4-8767-9c910610c9f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:32.626588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:34.332871 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:59.078770 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3d408661-7567-4b77-88de-3a5b03f82004 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:00.325922 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 5 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:39:01.481105 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:01.659040 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-0759520e-9e79-4eb5-a5ee-a4bc619a923d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:02.630630 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:04.337351 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:29.081781 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-17a91358-141c-4a4e-bf4b-7cb954bc1aad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:31.484992 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:31.661011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-801e0995-afbb-4315-be62-5dbf441033e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:32.634187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:34.313734 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966'] for agent, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:34.337289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:37.324987 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:39:47.249432 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53408) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:47.357919 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cd963782-38bd-4895-8e5b-3c9030f178ab admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1074257 May 25 15:39:49.483071 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53418) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:49.540024 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7d99c4b1-0db1-4f5d-91e8-c280c57e260d admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0557964 May 25 15:39:59.084969 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7394706f-fe2c-4b51-94ea-da16a3440cd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.486772 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.665130 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-288a423b-1e47-474f-aaf4-eeb83ee5cad1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.636816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.279233 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.340128 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:14.324525 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:40:29.086135 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-72c01c02-61e4-4fec-a73a-2d20fc172663 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.488614 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.665725 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f2d82b01-8a41-48cf-b0e9-175c13173b84 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:32.640681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.293064 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.344536 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.323778 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:40:59.089393 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9e028d93-4f9c-456f-9889-285ad92fbe8c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.492535 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.670600 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f6fa2270-5345-4177-9358-e78ea8eb40b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.645082 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:04.292043 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:04.347398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.637775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53584) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:17.738956 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53598) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:17.844146 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1889308167-network', 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:17.849004 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:17.852915 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Usage tracker for resource:network and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:17.856177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:17.862317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:17.874836 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:17.877688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.894988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.909781 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:17.913628 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Usage tracker for resource:security_group_rule and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:17.916815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:17.923024 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.000983 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-189184680-network', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.014508 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.028294 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Usage tracker for resource:network and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.034808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.036099 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.041924 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.042883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.055668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.074603 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] vlan segment allocate from pool success with {'vlan_id': 836, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:18.089513 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8792484777957', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.090243 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Unsubscribe: segment precommit_create {{(pid=98392) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 15:41:18.090772 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Added segment 6bca21b3-aa16-450a-a9ae-5cdc39f91476 of type vlan for network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 May 25 15:41:18.137288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Made reservation on behalf of 0b066f0c91e94675a5051ab935c145f5 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:18.140292 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.150425 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.159401 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53628) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.172884 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.186300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.215983 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.217339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.217339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.217698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.217978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.218481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.218968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.219450 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.220206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.220908 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.221921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.222418 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Tracked resource versions report: May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: pushed versions: May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: { 'AddressGroup': {'1.2'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'ConntrackHelper': {'1.0'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Log': {'1.0'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Network': {'1.1'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Port': {'1.7'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'PortForwarding': {'1.2'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'QosPolicy': {'1.8'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroup': {'1.4'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroupRule': {'1.2'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SubPort': {'1.0'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Subnet': {'1.1'}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Trunk': {'1.1'}} May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: consumer versions: May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: HyperV agent@hv-cinder-78638: {}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'ConntrackHelper': '1.0', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Log': '1.0', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Network': '1.1', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Port': '1.7', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'PortForwarding': '1.2', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'QosPolicy': '1.8', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroup': '1.4', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SecurityGroupRule': '1.2', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'SubPort': '1.0', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Subnet': '1.1', May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: 'Trunk': '1.1'}} May 25 15:41:18.223588 dv-cinder-786383-6-iscsi neutron-server[98392]: {{(pid=98392) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:41:18.228818 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.234649 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.235637 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.238945 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.244711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.248326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.254380 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:18.254984 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.260430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.377621 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Pushing event updated for resources: {'Network': ['ID=956d5f61-ae8e-4c95-bd97-6ae439ceff67,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.384576 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.395831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53646) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.396661 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:18.401717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Request body: {'subnet': {'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1889308167-subnet', 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.406551 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.7664127 May 25 15:41:18.411466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.416762 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Usage tracker for resource:subnet and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.421632 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.434063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.463114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:18.465444 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.512523 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.524383 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.536429 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] vlan segment allocate from pool success with {'vlan_id': 834, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:18.547326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.547970 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Added segment 5d94defc-ad75-4154-8cd1-61c6b951613a of type vlan for network 132a5a94-c14e-4969-994e-837fe8b01394 May 25 15:41:18.579113 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.587946 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.629605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97ee5f13-a655-4bdd-88d0-3c054007e484,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.633897 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.649165 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.650300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:18.651027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.661607 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-network', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.666813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.670769 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Usage tracker for resource:network and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.673641 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.674481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f64eb31f-ae22-45fd-b5e5-332d52ce419c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.679472 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.699071 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53658) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.699231 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.9590993 May 25 15:41:18.752574 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53662) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.753228 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53664) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.757877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Request body: {'subnet': {'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-189184680-subnet', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.761510 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Made reservation on behalf of dd09b4c567df401194ac3825fe2e3080 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:18.764313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.781320 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.786835 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Usage tracker for resource:subnet and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.790572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.793164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Pushing event updated for resources: {'Network': ['ID=132a5a94-c14e-4969-994e-837fe8b01394,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.796812 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.804973 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 132a5a94-c14e-4969-994e-837fe8b01394 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:18.821892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.836464 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.855236 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Made reservation on behalf of 0b066f0c91e94675a5051ab935c145f5 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:18.858617 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.903027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-389735979-network', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.908617 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.916617 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Usage tracker for resource:network and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:18.924399 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:18.937975 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:18.963241 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1199676268-network', 'tenant_id': '4d321f2af3214e7d853ab4248bfea864'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:18.978310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:18.986835 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Made reservation on behalf of 53352f5306c64e2191fc3770c3f34cb6 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:18.989218 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.022148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.048831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Usage tracker for resource:network and tenant:4d321f2af3214e7d853ab4248bfea864 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:19.064502 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:19.071991 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:19.075586 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Usage tracker for resource:security_group_rule and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:19.084713 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:19.086821 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:19.092434 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:19.094771 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:19.110839 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:19.111785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:19.121872 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:19.207949 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Made reservation on behalf of 4d321f2af3214e7d853ab4248bfea864 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:19.210403 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.232796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.261618 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:19.267686 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Usage tracker for resource:security_group_rule and tenant:4d321f2af3214e7d853ab4248bfea864 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:19.271714 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.272850 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:19.279876 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:19.283613 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.294049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.327482 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00365c48-5483-4397-bb25-b532a8407a6f,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.333783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.352012 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] vlan segment allocate from pool success with {'vlan_id': 845, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:19.369200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.369644 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Added segment dca04af7-3ba4-4736-9f48-ea4624485914 of type vlan for network e2c8de13-6b38-480d-a253-7798199b43d7 May 25 15:41:19.414883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.478901 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.486555 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.488218 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.495863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.521673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.523489 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:19.524368 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.532671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b829a5c6-1f8b-4e38-893d-5965279c6b75,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.542958 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.547004 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.012s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.549111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.570452 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27492498-f85f-476f-914f-ee8623f9a20b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.660217 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e88a0fa9-0a06-4f49-aca1-a79164cf520e,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.677317 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.677664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.678000 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.678330 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.678654 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.685644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.686265 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.686625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.686950 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.687278 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.687622 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.687947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Tracked resource versions report: May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: pushed versions: May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: { 'AddressGroup': {'1.2'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'ConntrackHelper': {'1.0'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Log': {'1.0'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Network': {'1.1'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Port': {'1.7'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'PortForwarding': {'1.2'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'QosPolicy': {'1.8'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroup': {'1.4'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroupRule': {'1.2'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SubPort': {'1.0'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Subnet': {'1.1'}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Trunk': {'1.1'}} May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: consumer versions: May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: HyperV agent@hv-cinder-78638: {}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'ConntrackHelper': '1.0', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Log': '1.0', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Network': '1.1', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Port': '1.7', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'PortForwarding': '1.2', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'QosPolicy': '1.8', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroup': '1.4', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SecurityGroupRule': '1.2', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'SubPort': '1.0', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Subnet': '1.1', May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: 'Trunk': '1.1'}} May 25 15:41:19.689008 dv-cinder-786383-6-iscsi neutron-server[98391]: {{(pid=98391) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:41:19.696592 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.700507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.731855 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] vlan segment allocate from pool success with {'vlan_id': 802, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:19.734567 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Pushing event updated for resources: {'Network': ['ID=e2c8de13-6b38-480d-a253-7798199b43d7,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.744711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.747768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network e2c8de13-6b38-480d-a253-7798199b43d7 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:19.757553 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.757895 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Added segment 12684b13-b98f-4241-9d70-842214716852 of type vlan for network 93554588-43bc-41aa-b595-47bd440305fb May 25 15:41:19.758756 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2d179db8-29c6-441e-922e-3c4cb54d6b04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.772991 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.0167899 May 25 15:41:19.783306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53708) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:19.794008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Request body: {'subnet': {'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-subnet', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:19.799408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:19.803314 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Usage tracker for resource:subnet and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:19.806537 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:19.813144 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:19.825607 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.833143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Made reservation on behalf of 53352f5306c64e2191fc3770c3f34cb6 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:19.835826 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.916053 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bf87cdb0-06e4-4ee0-ad97-e62e40212515,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.921922 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.960023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.db.resource_extend [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:41:20.016968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.020901 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:20.021635 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.024121 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Checking segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:20.024610 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Network hostable DHCP agents. Network: 956d5f61-ae8e-4c95-bd97-6ae439ceff67, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:20.034340 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.db.api [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=98391) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 25 15:41:20.034963 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_db.api [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 25 15:41:20.037312 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.064827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:20.123703 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.3690259 May 25 15:41:20.128502 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53736) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:20.137693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Request body: {'subnet': {'network_id': '93554588-43bc-41aa-b595-47bd440305fb', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1199676268-subnet', 'tenant_id': '4d321f2af3214e7d853ab4248bfea864', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:20.150887 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:20.156965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Pushing event updated for resources: {'Network': ['ID=93554588-43bc-41aa-b595-47bd440305fb,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:20.160248 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Usage tracker for resource:subnet and tenant:4d321f2af3214e7d853ab4248bfea864 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:20.164929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:20.166814 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 93554588-43bc-41aa-b595-47bd440305fb details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:20.167697 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.198613 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:20.203767 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 956d5f61-ae8e-4c95-bd97-6ae439ceff67) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:20.209216 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:20.210082 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.244823 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Made reservation on behalf of 4d321f2af3214e7d853ab4248bfea864 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:20.245533 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fb57c42-e73e-4261-9066-bdc43d789cf3 None None] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:20.247179 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.259370 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.8623667 May 25 15:41:20.272248 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.277992 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-63b16257-42c0-4445-a962-2f7801586f25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.340349 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc89f65d-3227-4230-ac5b-a3041bcec0e2,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:20.343759 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.385293 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Checking segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:20.385952 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Network hostable DHCP agents. Network: 132a5a94-c14e-4969-994e-837fe8b01394, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:20.410823 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Network 132a5a94-c14e-4969-994e-837fe8b01394 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:20.434207 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 132a5a94-c14e-4969-994e-837fe8b01394) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:20.449273 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:20.450486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.483145 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e244bb0c-ff25-4400-9227-5a755233beb1 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.7792490 May 25 15:41:20.485481 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53746) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:20.493312 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:20.504754 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:20.511830 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Usage tracker for resource:router and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:20.515652 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:20.521922 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:20.534913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.536460 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.541987 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.586156 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.598703 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b408acad-47a3-4925-9d7c-0d9a0c61a4ff None None] Network 132a5a94-c14e-4969-994e-837fe8b01394 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:20.642214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53752) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:20.671708 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] vlan segment allocate from pool success with {'vlan_id': 800, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:20.694425 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:20.694770 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Added segment 2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da of type vlan for network f2d88153-7a7c-4433-8f94-c27a6e5feb07 May 25 15:41:21.034133 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.035664 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-401d4f02-016f-4986-b30c-9b9ecb738cd8 None None] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:21.051446 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.067797 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-132a5a94-c14e-4969-994e-837fe8b01394', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:41:21.068968 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.183418 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:21.188781 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.196913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Usage tracker for resource:security_group_rule and tenant:03f9b884e6ca443498fdfc21146e0489 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:21.209485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.211567 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:21.217499 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.226080 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:21.287000 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.305869 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:21.306194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.322343 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0eddaf48-c485-4fd6-aa56-c8209ff2711a,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:21.324993 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.337340 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.343476 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53790) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:21.351738 dv-cinder-786383-6-iscsi neutron-server[98392]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 25 15:41:21.395677 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Checking segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:21.397244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Network hostable DHCP agents. Network: e2c8de13-6b38-480d-a253-7798199b43d7, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:21.457501 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Allocated IP 172.20.0.2 (132a5a94-c14e-4969-994e-837fe8b01394/cc89f65d-3227-4230-ac5b-a3041bcec0e2/20644580-7d23-420c-865a-3231c7bc8205) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:21.510765 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Pushing event updated for resources: {'Network': ['ID=f2d88153-7a7c-4433-8f94-c27a6e5feb07,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:21.516856 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.533993 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 3.3727698 May 25 15:41:21.539778 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53794) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:21.545235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Request body: {'subnet': {'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-subnet', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:21.561940 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:21.568763 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Network e2c8de13-6b38-480d-a253-7798199b43d7 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:21.572615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Usage tracker for resource:subnet and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:21.578385 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:21.582715 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:21.590236 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, e2c8de13-6b38-480d-a253-7798199b43d7) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:21.592103 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:21.597483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:21.598004 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.599814 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.611354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.612149 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61fb49a2-637c-4118-af4e-7366bec4b997 None None] Network e2c8de13-6b38-480d-a253-7798199b43d7 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:21.612869 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Made reservation on behalf of dd09b4c567df401194ac3825fe2e3080 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:21.615133 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.643520 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.8587747 May 25 15:41:21.653956 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53800) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:21.660540 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.677177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:21.681829 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:21.686323 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Usage tracker for resource:router and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:21.689413 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:21.695184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:21.710474 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.718670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a8f6aa9a-9106-42ef-8f08-6d0eb0292cce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:21.719425 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a8f6aa9a-9106-42ef-8f08-6d0eb0292cce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:21.728460 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9dea5b6b-5261-4f61-bf57-62eb51be00c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.765125 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.766203 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.826675 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.846442 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a8f6aa9a-9106-42ef-8f08-6d0eb0292cce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:21.847656 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a8f6aa9a-9106-42ef-8f08-6d0eb0292cce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.5026393 May 25 15:41:21.884038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Checking segment: {'id': '12684b13-b98f-4241-9d70-842214716852', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '93554588-43bc-41aa-b595-47bd440305fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:21.884393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Network hostable DHCP agents. Network: 93554588-43bc-41aa-b595-47bd440305fb, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:21.888483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Pushing event updated for resources: {'Subnet': ['ID=109089f6-966f-46c3-ac4d-c0610e95a24b,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:21.896493 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.898410 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-e65dbfb3-eadc-4e41-8019-66868c7acb72 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/quotas/fe662b5dcc2c4a1da1aa9473bd7e9dd7 HTTP/1.1" status: 200 len: 375 time: 0.0388930 May 25 15:41:21.953029 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=03f9b884e6ca443498fdfc21146e0489&name=default HTTP/1.1" status: 200 len: 2975 time: 1.3068860 May 25 15:41:21.958691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53812) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:22.024882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c5250e3-ce5c-488d-9fae-2e173e8cdb16,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:22.033841 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.373s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:22.120513 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a050b409-0574-4ba4-aa97-37c31e45c386 None None] Network e2c8de13-6b38-480d-a253-7798199b43d7 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:22.131742 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a7a302ac-4f51-4aaf-866f-146d49142de5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1685691 May 25 15:41:22.363026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.368684 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.381843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Network 93554588-43bc-41aa-b595-47bd440305fb is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:22.403472 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 93554588-43bc-41aa-b595-47bd440305fb) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:22.416104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:22.416703 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.436643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Transition to ACTIVE for port object 20644580-7d23-420c-865a-3231c7bc8205 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:22.439121 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aceec48f-9140-48da-a97a-39bbab3a1a99 None None] Network 93554588-43bc-41aa-b595-47bd440305fb requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:22.464172 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-57e0ae87-55ae-4fda-8ec4-ccb6f7fa5b0b service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:41:22.466257 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-57e0ae87-55ae-4fda-8ec4-ccb6f7fa5b0b service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1325819 May 25 15:41:22.466720 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.499643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.537602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Transition to ACTIVE for port object 20644580-7d23-420c-865a-3231c7bc8205 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:22.559235 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.562981 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.4334681 May 25 15:41:22.568930 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.577985 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.609507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.665938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Network 132a5a94-c14e-4969-994e-837fe8b01394 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:22.673122 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:22.679792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:22.738545 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.743059 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.751610 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Pushing event updated for resources: {'Port': ['ID=20644580-7d23-420c-865a-3231c7bc8205,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:22.802893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c5250e3-ce5c-488d-9fae-2e173e8cdb16,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:22.834981 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a7f4675-5ef6-4003-971a-36f0f2fb5853 None None] Network 93554588-43bc-41aa-b595-47bd440305fb requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:22.846212 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:22.852498 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.852851 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.853166 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.853493 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.853806 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.854129 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.854448 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.854763 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.855100 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.855416 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.855752 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.856062 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Tracked resource versions report: May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: pushed versions: May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: { 'AddressGroup': {'1.2'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'ConntrackHelper': {'1.0'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Log': {'1.0'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Network': {'1.1'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Port': {'1.7'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'PortForwarding': {'1.2'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'QosPolicy': {'1.8'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroup': {'1.4'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroupRule': {'1.2'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SubPort': {'1.0'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Subnet': {'1.1'}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Trunk': {'1.1'}} May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: consumer versions: May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: HyperV agent@hv-cinder-78638: {}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'ConntrackHelper': '1.0', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Log': '1.0', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Network': '1.1', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Port': '1.7', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'PortForwarding': '1.2', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'QosPolicy': '1.8', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroup': '1.4', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SecurityGroupRule': '1.2', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'SubPort': '1.0', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Subnet': '1.1', May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: 'Trunk': '1.1'}} May 25 15:41:22.857143 dv-cinder-786383-6-iscsi neutron-server[98393]: {{(pid=98393) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:41:22.915583 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Allocated IP 172.27.1.101 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/0bf5221e-392d-4673-990d-1644c22ab960) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:22.926184 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-c1a1797e-66fb-4f9e-8832-a73fa06251e5 service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3905571 May 25 15:41:22.926616 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.926616 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0c5250e3-ce5c-488d-9fae-2e173e8cdb16 HTTP/1.1" status: 204 len: 168 time: 0.9621589 May 25 15:41:22.926616 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:22.936193 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0bccf0f3-6d3f-4f3a-bb13-8abcab6d3444 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.945468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.368s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.094046 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Attempting to bind port 20644580-7d23-420c-865a-3231c7bc8205 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:23.094495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Attempting to bind port 20644580-7d23-420c-865a-3231c7bc8205 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:23.095097 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Attempting to bind port 20644580-7d23-420c-865a-3231c7bc8205 on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:23.122968 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:23.132948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Checking segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:23.132948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.132948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Bound using segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:23.132948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Bound port: 20644580-7d23-420c-865a-3231c7bc8205, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:23.132948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.174415 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-afb5ebab-dbc8-4eae-9589-385539d18093 service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2550099 May 25 15:41:23.175144 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=139c7c04-45f8-44c4-90ec-3068f09f624c,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:23.184610 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.190822 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Checking segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:23.191178 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Network hostable DHCP agents. Network: f2d88153-7a7c-4433-8f94-c27a6e5feb07, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:23.243695 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:23.263185 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.273331 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, f2d88153-7a7c-4433-8f94-c27a6e5feb07) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:23.276612 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:23.277246 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.330622 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.7872925 May 25 15:41:23.331069 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53854) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:23.340099 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:23.346256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.347140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:23.357615 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3f71bd8-2791-4708-8657-19d06aab1556 None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:23.359443 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.406312 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Usage tracker for resource:router and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:23.422326 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:23.432228 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:23.437380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:23.441264 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:23.443232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:23.494544 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.553380 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.662632 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Pushing event updated for resources: {'Port': ['ID=0bf5221e-392d-4673-990d-1644c22ab960,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:23.694727 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53892) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:23.744565 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.385s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.745394 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.746602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.773499 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] For port 20644580-7d23-420c-865a-3231c7bc8205, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:23.801779 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] For port 20644580-7d23-420c-865a-3231c7bc8205, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=20644580-7d23-420c-865a-3231c7bc8205,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:23.829724 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.864140 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:23.881644 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.914770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-a7434ce7-67c7-4cd3-a76e-033986ee6355 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:23.916361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-a7434ce7-67c7-4cd3-a76e-033986ee6355 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Synchronizing usage tracker for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:24.006886 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Pushing event updated for resources: {'Port': ['ID=20644580-7d23-420c-865a-3231c7bc8205,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:24.010432 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.069976 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-a7434ce7-67c7-4cd3-a76e-033986ee6355 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Unset dirty status for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:24.076731 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-a7434ce7-67c7-4cd3-a76e-033986ee6355 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/networks?id=93554588-43bc-41aa-b595-47bd440305fb HTTP/1.1" status: 200 len: 812 time: 0.3810074 May 25 15:41:24.142991 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d30a6c13-8063-446f-bc35-303c7fd35321 req-a38e17b5-5657-4b35-a198-518c02c85c8f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.1994309 May 25 15:41:24.146476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:41:24.147932 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.190424 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-c4bb8cff-38a9-4a5d-ac7d-0daa5d8191c4 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/quotas/4d321f2af3214e7d853ab4248bfea864 HTTP/1.1" status: 200 len: 375 time: 0.1005507 May 25 15:41:24.317949 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53918) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:24.326729 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Allocated IP 172.27.1.116 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/6f262988-6838-4979-94fe-63855563e32b) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:24.408694 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-7b7cde9b-357c-4ec6-905a-453e3b44cbb0 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=4d321f2af3214e7d853ab4248bfea864&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1950176 May 25 15:41:24.508201 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Allocated IP 172.20.0.2 (f2d88153-7a7c-4433-8f94-c27a6e5feb07/139c7c04-45f8-44c4-90ec-3068f09f624c/62db4b26-5b19-4262-87e1-6259d7e05e49) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:24.687027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1006445664-network', 'tenant_id': 'fe9c838cd1824cbe93a14ad56eb903e6'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:24.696462 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:24.707383 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Usage tracker for resource:network and tenant:fe9c838cd1824cbe93a14ad56eb903e6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:24.714928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:24.738020 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:24.745904 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-3652c083-53ea-4120-bcdd-dea8b4125932 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:41:24.747121 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-3652c083-53ea-4120-bcdd-dea8b4125932 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1174388 May 25 15:41:24.849871 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Made reservation on behalf of fe9c838cd1824cbe93a14ad56eb903e6 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:24.852849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.853632 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.870002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.885988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.898810 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.911684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Transition to ACTIVE for port object 62db4b26-5b19-4262-87e1-6259d7e05e49 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:24.913854 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.931229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:24.935056 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Transition to ACTIVE for port object 62db4b26-5b19-4262-87e1-6259d7e05e49 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:24.947382 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:24.952710 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Usage tracker for resource:security_group_rule and tenant:fe9c838cd1824cbe93a14ad56eb903e6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:24.956691 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.968758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:24.992654 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:25.008282 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-61b568cd-1397-4839-8e74-923cb4ca0659 service neutron] 10.222.0.25 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2532442 May 25 15:41:25.041027 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:25.045195 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:25.048993 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:25.139475 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Pushing event updated for resources: {'Port': ['ID=62db4b26-5b19-4262-87e1-6259d7e05e49,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:25.197096 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:25.242900 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Attempting to bind port 62db4b26-5b19-4262-87e1-6259d7e05e49 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:25.244341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.244855 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Attempting to bind port 62db4b26-5b19-4262-87e1-6259d7e05e49 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:25.245236 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Attempting to bind port 62db4b26-5b19-4262-87e1-6259d7e05e49 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:25.256476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:25.256852 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Checking segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:25.257301 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.257759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Bound using segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:25.258945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Bound port: 62db4b26-5b19-4262-87e1-6259d7e05e49, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:25.259483 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.270037 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:25.393299 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] For port 62db4b26-5b19-4262-87e1-6259d7e05e49, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:25.397326 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] For port 62db4b26-5b19-4262-87e1-6259d7e05e49, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=62db4b26-5b19-4262-87e1-6259d7e05e49,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:25.404237 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.407244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:25.410487 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:25.418206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:25.421488 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:25.503088 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Pushing event updated for resources: {'Port': ['ID=62db4b26-5b19-4262-87e1-6259d7e05e49,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:25.514943 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:25.518030 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48ae4902-dd8e-454c-bad0-08a105359522 None None] Network 132a5a94-c14e-4969-994e-837fe8b01394 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:25.568685 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-8e32ffe1-c40e-4433-b94c-c949d8ef6c97 service neutron] 10.222.0.25 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5471799 May 25 15:41:25.588840 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cb833925-b205-4137-b755-2e8ae3c0da85 req-0268c9a6-7abd-42b4-83f2-0c74ada36832 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.3200486 May 25 15:41:25.614059 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Pushing event updated for resources: {'Port': ['ID=6f262988-6838-4979-94fe-63855563e32b,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:25.617788 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:25.667697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.680655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.704188 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.736441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:25.790065 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] vlan segment allocate from pool success with {'vlan_id': 828, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:25.877606 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-a2cd96a0-aa8a-41f1-a552-3dc8368403ec None None] Provisioning for port 20644580-7d23-420c-865a-3231c7bc8205 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:25.983037 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 20644580-7d23-420c-865a-3231c7bc8205 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:25.983489 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:25.983859 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Added segment b5306959-4a34-46e9-bfbe-42c43ed590c4 of type vlan for network fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 May 25 15:41:26.033459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=875955fc-0649-4ca5-a4ab-06401f1ffc7e,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:26.036686 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:26.060727 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9190b43-9e2c-4f63-bec8-94bba756282c req-f03a1616-4eed-4420-acb3-63ec62a82f88 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.1088464 May 25 15:41:26.131057 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 20644580-7d23-420c-865a-3231c7bc8205 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:26.139357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 20644580-7d23-420c-865a-3231c7bc8205 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:26.139786 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.176822 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.232794 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.236503 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.275519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.345179 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.354618 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.358671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:26.371955 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.392942 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 20644580-7d23-420c-865a-3231c7bc8205, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=20644580-7d23-420c-865a-3231c7bc8205,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:26.394925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:26.399734 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.405889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:26.446581 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:41:26.504427 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=20644580-7d23-420c-865a-3231c7bc8205,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:26.507953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-a34dbcd4-8f0d-4f63-9d08-7722a688251a None None] Provisioning complete for port 20644580-7d23-420c-865a-3231c7bc8205 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:26.508687 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a34dbcd4-8f0d-4f63-9d08-7722a688251a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:26.547889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:26.556050 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Allocated IP 172.27.1.127 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/57114f18-b5af-4c03-b3c4-d90bf7703373) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:26.711306 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.3871748 May 25 15:41:26.716052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54000) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:26.718108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Pushing event updated for resources: {'Network': ['ID=fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:26.724430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.329s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:26.746860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Request body: {'subnet': {'network_id': 'fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1006445664-subnet', 'tenant_id': 'fe9c838cd1824cbe93a14ad56eb903e6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:26.763339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:26.805404 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:26.914052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Usage tracker for resource:subnet and tenant:fe9c838cd1824cbe93a14ad56eb903e6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:26.918387 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:26.924836 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:26.977560 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:26.987932 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:26.998110 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36b4ff59-0834-4eb0-a09d-582f13fdf8e8 None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:27.003506 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:27.003760 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:27.035867 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Made reservation on behalf of fe9c838cd1824cbe93a14ad56eb903e6 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:27.038444 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:27.079938 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-abee47be-c36c-4b4a-8473-486deff60d56 req-a60d25b5-0ed8-453e-8dec-f939618335f4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.1411474 May 25 15:41:27.083091 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:27.087593 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 6.6007185 May 25 15:41:27.089060 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54016) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:27.094621 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:27.134458 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-4f23cf7f-bfcb-47bd-a8bc-fef6989b5eb7 None None] Provisioning for port 62db4b26-5b19-4262-87e1-6259d7e05e49 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:27.149554 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:27.159269 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cbbb2ce0-d57d-4ee6-82a0-d8668621399f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:27.270666 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:27.274847 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:27.279339 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:27.312342 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:27.371980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Pushing event updated for resources: {'Port': ['ID=57114f18-b5af-4c03-b3c4-d90bf7703373,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:27.375361 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:27.692358 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5a25cae7-19fb-4456-a9f4-caafbd03b513 req-1c76a10b-e4c6-40c1-bc46-8f56484a0ba3 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.3577809 May 25 15:41:27.721352 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:23Z', 'revision_number': 3, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:27.734216 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:27.734518 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Updating router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 port 0bf5221e-392d-4673-990d-1644c22ab960 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:27.830011 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:27.849583 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.014154 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 62db4b26-5b19-4262-87e1-6259d7e05e49 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:28.059011 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.164851 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 62db4b26-5b19-4262-87e1-6259d7e05e49 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:28.173230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 62db4b26-5b19-4262-87e1-6259d7e05e49 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:28.173230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.373498 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.380658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.392741 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.405624 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Transition to ACTIVE for port object 0bf5221e-392d-4673-990d-1644c22ab960 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:28.429107 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.434979 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:41:28.461632 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:28.477196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 62db4b26-5b19-4262-87e1-6259d7e05e49, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=62db4b26-5b19-4262-87e1-6259d7e05e49,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:28.485696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.488039 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 20644580-7d23-420c-865a-3231c7bc8205 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:28.606276 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:28.630927 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Attempting to bind port 0bf5221e-392d-4673-990d-1644c22ab960 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:28.639359 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Attempting to bind port 0bf5221e-392d-4673-990d-1644c22ab960 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:28.644911 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Attempting to bind port 0bf5221e-392d-4673-990d-1644c22ab960 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:28.661326 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:28.662031 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:28.665375 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.665970 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:28.666656 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Bound port: 0bf5221e-392d-4673-990d-1644c22ab960, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:28.667256 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.673267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.74', 61704) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:28.676642 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-26394ccb-aa8c-43c3-bdb8-8d0309262231 req-f577cbcd-570b-427a-b312-1021e8c10c7c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.3931258 May 25 15:41:28.736444 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 20644580-7d23-420c-865a-3231c7bc8205 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:28.736820 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:28.809861 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Pushing event updated for resources: {'Port': ['ID=0bf5221e-392d-4673-990d-1644c22ab960,revision_number=2']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:28.816515 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Router e15748c9-8f60-49f9-a768-dc9676a5b123 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:41:28.836740 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=62db4b26-5b19-4262-87e1-6259d7e05e49,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:28.843508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:28.853476 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.860180 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.861085 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.861600 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.862151 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.863042 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.863767 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.864285 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.864818 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.865361 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.865838 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.866427 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Tracked resource versions report: May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: pushed versions: May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: { 'AddressGroup': {'1.2'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'ConntrackHelper': {'1.0'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Log': {'1.0'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Network': {'1.1'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Port': {'1.7'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'PortForwarding': {'1.2'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'QosPolicy': {'1.8'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroup': {'1.4'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroupRule': {'1.2'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SubPort': {'1.0'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Subnet': {'1.1'}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Trunk': {'1.1'}} May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: consumer versions: May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: { DHCP agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: HyperV agent@hv-cinder-78638: {}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: L3 agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: Metadata agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: Metering agent@dv-cinder-786383-6-iscsi: {}, May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: Open vSwitch agent@dv-cinder-786383-6-iscsi: { 'AddressGroup': '1.2', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'ConntrackHelper': '1.0', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Log': '1.0', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Network': '1.1', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Port': '1.7', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'PortForwarding': '1.2', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'QosPolicy': '1.8', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroup': '1.4', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SecurityGroupRule': '1.2', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'SubPort': '1.0', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Subnet': '1.1', May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: 'Trunk': '1.1'}} May 25 15:41:28.869230 dv-cinder-786383-6-iscsi neutron-server[98394]: {{(pid=98394) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:41:28.908616 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.447s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:28.965234 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] For port 0bf5221e-392d-4673-990d-1644c22ab960, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:28.979301 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] For port 0bf5221e-392d-4673-990d-1644c22ab960, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=0bf5221e-392d-4673-990d-1644c22ab960,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:28.987112 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:29.004959 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-f7128ea8-2779-4d5e-ab59-3637a6d8e337 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:29.037116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-55928885-c463-490d-87d5-2f4d305e7103 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:29.038539 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-55928885-c463-490d-87d5-2f4d305e7103 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.3609409 May 25 15:41:29.055259 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8c027829-6785-4fd6-a70c-8f3ffd31367d req-875c3867-1318-484d-840f-c1795993c593 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.0948753 May 25 15:41:29.115032 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Pushing event updated for resources: {'Port': ['ID=0bf5221e-392d-4673-990d-1644c22ab960,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:29.118928 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-233aeac0-2a26-4066-941d-4d7f8cc60f3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:29.130124 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:29.152703 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:29.154379 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:29.191105 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Request body: {'port': {'device_id': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'admin_state_up': True, 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:29.344057 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:29.347821 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98392) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:41:29.353781 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:29.367044 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:29.367611 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:29.387970 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:29.389897 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 6.0576417 May 25 15:41:29.392750 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54088) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:29.522312 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:29.589952 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:29.806002 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:29.851319 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.74', 61713) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:29.961530 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 62db4b26-5b19-4262-87e1-6259d7e05e49 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:30.220829 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-069ef541-df2e-4da2-9733-a197e571a881 req-6425fe70-0ae3-45d9-8d21-8f8796f94c90 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.3353260 May 25 15:41:30.239288 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 62db4b26-5b19-4262-87e1-6259d7e05e49 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:30.240299 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:30.246144 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:23Z', 'revision_number': 3, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:30.264481 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcf7ed90-38b4-4d20-b164-7c5e9cd5b263 None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:23Z', 'revision_number': 3, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:30.578312 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-cbc2553a-1a44-4542-b930-8db1f0cf1a91 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:30.580777 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-cbc2553a-1a44-4542-b930-8db1f0cf1a91 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.74 "GET /v2.0/networks?id=93554588-43bc-41aa-b595-47bd440305fb HTTP/1.1" status: 200 len: 812 time: 0.6055095 May 25 15:41:30.602447 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:27Z', 'revision_number': 3, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:30.611068 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:30.611424 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Updating router e15748c9-8f60-49f9-a768-dc9676a5b123 port 57114f18-b5af-4c03-b3c4-d90bf7703373 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:30.692631 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:30.824641 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:30.839960 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Sync routers for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:30.857728 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:30.858662 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:30.942158 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40fc1f02-77ba-4640-9004-0322fdc2a447 req-b88a28fb-b98c-4193-ad0f-0eba775d354c tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.7146685 May 25 15:41:31.032693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:31.045848 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Usage tracker for resource:port and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:31.049300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:31.066808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:31.096929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:31.111283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.491891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.500081 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 9.8449385 May 25 15:41:31.525068 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:31.564542 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.574041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Allocated IP 172.20.0.14 (956d5f61-ae8e-4c95-bd97-6ae439ceff67/bf87cdb0-06e4-4ee0-ad97-e62e40212515/0412da35-fecb-4a70-b77f-dbb7dc9fcd61) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:31.675200 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54154) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:31.860211 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-195a5b67-77fe-456e-a16f-a73a7071817e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.920286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.967483 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Transition to ACTIVE for port object 57114f18-b5af-4c03-b3c4-d90bf7703373 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:31.981588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.999994 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.101675 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 0bf5221e-392d-4673-990d-1644c22ab960 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:32.238388 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b74edce0-6f65-452e-9130-77f2d08b2f78 req-519d40c3-b5d4-4600-aa01-9480f8014c7a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.7778111 May 25 15:41:32.251178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.299597 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.357135 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Allocated IP 172.20.0.1 (132a5a94-c14e-4969-994e-837fe8b01394/cc89f65d-3227-4230-ac5b-a3041bcec0e2/6d2d8f03-a534-4b34-94da-7da100d11936) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:32.383610 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bb4c1904-f6f3-4f62-89fe-bc38ca70eb90 req-4b803208-5bab-4fef-9958-2696968ac5f6 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.1355398 May 25 15:41:32.437345 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Pushing event updated for resources: {'Port': ['ID=57114f18-b5af-4c03-b3c4-d90bf7703373,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:32.456545 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:25Z', 'revision_number': 3, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:32.457393 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.455s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.466053 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Attempting to bind port 57114f18-b5af-4c03-b3c4-d90bf7703373 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:32.467750 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Checking router: 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:32.468106 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Updating router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 port 6f262988-6838-4979-94fe-63855563e32b binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:32.472112 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Attempting to bind port 57114f18-b5af-4c03-b3c4-d90bf7703373 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:32.472610 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Attempting to bind port 57114f18-b5af-4c03-b3c4-d90bf7703373 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:32.503035 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:32.503868 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:32.504334 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.504747 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:32.505334 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Bound port: 57114f18-b5af-4c03-b3c4-d90bf7703373, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:32.507405 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.608628 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.613140 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] For port 57114f18-b5af-4c03-b3c4-d90bf7703373, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:32.617004 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] For port 57114f18-b5af-4c03-b3c4-d90bf7703373, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=57114f18-b5af-4c03-b3c4-d90bf7703373,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:32.619060 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 0bf5221e-392d-4673-990d-1644c22ab960 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:32.626823 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Transition to ACTIVE for port object 6d2d8f03-a534-4b34-94da-7da100d11936 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:32.629381 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.631899 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 0bf5221e-392d-4673-990d-1644c22ab960 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:32.633158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.663887 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.665464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54170) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:32.669857 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.708180 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-5d296566-0740-4dc1-9bd2-3c3fa1ee128c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.710704 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.720083 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.734302 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Allocated IP 172.20.0.1 (f2d88153-7a7c-4433-8f94-c27a6e5feb07/139c7c04-45f8-44c4-90ec-3068f09f624c/15d1697c-ee7f-4919-b595-da6a79fd36cc) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:32.862492 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:32.873824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:33.055114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.073006 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Network 132a5a94-c14e-4969-994e-837fe8b01394 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:33.075000 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Transition to ACTIVE for port object 15d1697c-ee7f-4919-b595-da6a79fd36cc will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:33.080870 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.104719 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Request body: {'port': {'device_id': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'network_id': '93554588-43bc-41aa-b595-47bd440305fb', 'admin_state_up': True, 'tenant_id': '4d321f2af3214e7d853ab4248bfea864'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:33.117735 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:33.132564 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.132849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:33.133155 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.174392 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:33.271174 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1c41ff01-9a3e-4f37-bcd6-67a682ad0bb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.414931 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.432584 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Transition to ACTIVE for port object 6f262988-6838-4979-94fe-63855563e32b will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:33.442783 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Pushing event updated for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.454930 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.460318 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-2c9eb051-26aa-4c47-8701-1db4089289ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.482679 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.505084 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:33.520431 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:33.581792 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.585528 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Usage tracker for resource:security_group_rule and tenant:5f04a1c9bf2d419e946730cb7fc76438 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:33.630231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:33.648761 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:33.649335 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.676688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:33.680535 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Attempting to bind port 6f262988-6838-4979-94fe-63855563e32b on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:33.681784 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Attempting to bind port 6f262988-6838-4979-94fe-63855563e32b by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:33.693395 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Attempting to bind port 6f262988-6838-4979-94fe-63855563e32b on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:33.710517 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Pushing event updated for resources: {'Port': ['ID=6f262988-6838-4979-94fe-63855563e32b,revision_number=2']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.716834 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:33.719989 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:33.721404 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.723327 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:33.734757 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Bound port: 6f262988-6838-4979-94fe-63855563e32b, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:33.738155 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.747457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:33.819970 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.359s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.894769 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.900631 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:33.904394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1df599fc-b5f5-4a3c-94e4-e251fe71de2c,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.908436 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Usage tracker for resource:port and tenant:4d321f2af3214e7d853ab4248bfea864 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:33.909614 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] For port 6f262988-6838-4979-94fe-63855563e32b, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:33.918535 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] For port 6f262988-6838-4979-94fe-63855563e32b, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6f262988-6838-4979-94fe-63855563e32b,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:33.919843 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:33.926072 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.936515 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:33.938281 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.973919 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-db869e3a-93c9-4792-88b3-7f43eccdd70d None None] Provisioning for port 6d2d8f03-a534-4b34-94da-7da100d11936 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:33.974880 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.255s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.983500 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Made reservation on behalf of 4d321f2af3214e7d853ab4248bfea864 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:33.987361 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cbca5c44-4bd1-48dd-ade3-ed5198b829c6 req-da913f15-b12b-4070-9516-f463c11ca0b1 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.2441862 May 25 15:41:33.992268 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07770e81-eb5d-4f2e-8f55-2a62e706bde8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.936s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:34.016706 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-db869e3a-93c9-4792-88b3-7f43eccdd70d None None] Provisioning complete for port 6d2d8f03-a534-4b34-94da-7da100d11936 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:34.017086 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-db869e3a-93c9-4792-88b3-7f43eccdd70d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.018332 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.080038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Pushing event updated for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.083088 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Checking segment: {'id': 'b5306959-4a34-46e9-bfbe-42c43ed590c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': 'fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:34.083821 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Network hostable DHCP agents. Network: fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:34.088866 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Pushing event updated for resources: {'Port': ['ID=57114f18-b5af-4c03-b3c4-d90bf7703373,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.093952 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:34.118012 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.409s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.194122 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event updated for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.196651 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:34.198733 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:34.199495 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:34.217772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.219785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.316s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:34.220693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.230091 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-db869e3a-93c9-4792-88b3-7f43eccdd70d None None] Port 6d2d8f03-a534-4b34-94da-7da100d11936 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:34.255343 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.324792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 0bf5221e-392d-4673-990d-1644c22ab960, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=0bf5221e-392d-4673-990d-1644c22ab960,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:34.331874 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:27Z', 'revision_number': 3, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:34.384183 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.397125 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Pushing event updated for resources: {'Port': ['ID=6f262988-6838-4979-94fe-63855563e32b,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.400867 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34621568-814a-4560-9fca-b2bee09b9cd6 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:27Z', 'revision_number': 3, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:34.403260 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:34.407162 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.469s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.413221 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:34.413909 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.423127 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:34.456936 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26410eb-b07a-4991-86fb-2cd2a0481bd1 req-1b99122b-3edc-4305-b5fa-e98e90bbd2b4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:34.458600 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b26410eb-b07a-4991-86fb-2cd2a0481bd1 req-1b99122b-3edc-4305-b5fa-e98e90bbd2b4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 932 time: 0.8699813 May 25 15:41:34.459462 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Network fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:34.541517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.542196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.603046 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-fe6b0216-503b-4b16-904f-e5810769c4b5 None None] Provisioning for port 15d1697c-ee7f-4919-b595-da6a79fd36cc completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:34.639142 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-fe6b0216-503b-4b16-904f-e5810769c4b5 None None] Provisioning complete for port 15d1697c-ee7f-4919-b595-da6a79fd36cc triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:34.652686 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fe6b0216-503b-4b16-904f-e5810769c4b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.690093 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.695235 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:34.758140 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d1324ed-d633-4b8b-947d-963e14e2be39 None None] Network fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:34.779864 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:34.780869 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.851586 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:34.925205 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b26410eb-b07a-4991-86fb-2cd2a0481bd1 req-5ace575a-b1cc-4966-98ac-8a74b71a806b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:34.983826 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.044614 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b26410eb-b07a-4991-86fb-2cd2a0481bd1 req-5ace575a-b1cc-4966-98ac-8a74b71a806b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:35.045829 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b26410eb-b07a-4991-86fb-2cd2a0481bd1 req-5ace575a-b1cc-4966-98ac-8a74b71a806b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4706681 May 25 15:41:35.079343 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.9038863 May 25 15:41:35.112019 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Allocated IP 172.20.0.14 (93554588-43bc-41aa-b595-47bd440305fb/109089f6-966f-46c3-ac4d-c0610e95a24b/47cc10ba-9942-4817-9ec9-0b0bdaf65164) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:35.296626 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=0bf5221e-392d-4673-990d-1644c22ab960,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:35.316590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.894s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:35.317353 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-fe6b0216-503b-4b16-904f-e5810769c4b5 None None] Port 15d1697c-ee7f-4919-b595-da6a79fd36cc cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:35.499122 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:25Z', 'revision_number': 3, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:35.523884 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824d11df-49ce-4b29-9c19-6e2a99f5a367 None None] The sync data for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi is: [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:25Z', 'revision_number': 3, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:35.535399 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.611415 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0a1a0d5d-ec4f-481c-a266-5be40980573c req-dfb6c63b-8ffc-4e11-b1cc-69371247fb32 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.1712053 May 25 15:41:35.617945 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 8.8919163 May 25 15:41:35.713448 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90353911-6950-4e30-9a05-bf445b4239ed None None] Network fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:35.714883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.715738 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.890152 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54208) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:35.891888 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.039129 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:36.071111 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5f04a1c9bf2d419e946730cb7fc76438&name=default HTTP/1.1" status: 200 len: 2977 time: 3.4015696 May 25 15:41:36.072254 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54214) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:36.098151 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:36.298489 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8be209b-9b5c-4a1b-931a-7164e6577ed0,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:36.309220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:36.401371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.442336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.491394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.543027 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Network 93554588-43bc-41aa-b595-47bd440305fb is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:36.588800 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:36.659852 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:36.689570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:36.690657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.751991 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:36.870475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:36.996626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Pushing event updated for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:37.026958 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 0bf5221e-392d-4673-990d-1644c22ab960 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:37.162750 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Pushing event updated for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:37.215813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.118s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:37.266689 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 0bf5221e-392d-4673-990d-1644c22ab960 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:37.267282 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.320417 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54234) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:37.349592 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1320605035-network', 'tenant_id': '203eb789c3e9438eab0ccb525ad70c17'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:37.432699 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.439000 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.3391352 May 25 15:41:37.494335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6f262988-6838-4979-94fe-63855563e32b up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:37.514516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:37.528558 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Usage tracker for resource:security_group_rule and tenant:b3d78977470c4e5a8375b1d8088f25ba is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:37.534160 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:37.539299 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:37.552298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:37.658948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 6f262988-6838-4979-94fe-63855563e32b completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:37.671681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 6f262988-6838-4979-94fe-63855563e32b triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:37.672218 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.682421 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.930s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:37.814562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.818522 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.838087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Usage tracker for resource:network and tenant:203eb789c3e9438eab0ccb525ad70c17 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:37.842371 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.846304 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:37.849288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:37.851233 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.899877 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.921101 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Network 132a5a94-c14e-4969-994e-837fe8b01394 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:37.936552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:37.960042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Pushing event updated for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:37.962943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:37.963538 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:37.965674 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:38.392309 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-13db7fa3-c60a-4d36-9113-83136f401c39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:38.392309 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.396289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.396289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 6f262988-6838-4979-94fe-63855563e32b, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6f262988-6838-4979-94fe-63855563e32b,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:38.396289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.396289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 57114f18-b5af-4c03-b3c4-d90bf7703373 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:38.400061 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Made reservation on behalf of 203eb789c3e9438eab0ccb525ad70c17 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:38.400061 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.401682 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:38.404440 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.404602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fc618a-282b-4edf-92db-3c579b5833bd req-e1baa092-f7dc-4f11-af41-bc5cb0021656 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:38.404602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-86fc618a-282b-4edf-92db-3c579b5833bd req-e1baa092-f7dc-4f11-af41-bc5cb0021656 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:38.404854 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:38.404854 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Usage tracker for resource:security_group_rule and tenant:203eb789c3e9438eab0ccb525ad70c17 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:38.405025 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b35a774-89b1-4809-b28b-1deeafa0856b,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:38.405025 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b3d78977470c4e5a8375b1d8088f25ba&name=default HTTP/1.1" status: 200 len: 2979 time: 2.4172969 May 25 15:41:38.405271 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:38.405271 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54238) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:38.405543 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:38.405643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 57114f18-b5af-4c03-b3c4-d90bf7703373 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:38.405643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 57114f18-b5af-4c03-b3c4-d90bf7703373 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:38.405643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.405970 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:38.406071 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-e0f57363-b48c-4547-b3f3-9db0c965e7da None None] Provisioning complete for port 6d2d8f03-a534-4b34-94da-7da100d11936 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:38.406071 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e0f57363-b48c-4547-b3f3-9db0c965e7da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.413107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:38.413107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:38.432377 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f71ec36-01a5-4576-8d7c-aab2397ca2ec req-2ab459f5-4f46-4f9c-a4d8-6774463cd054 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:38.437574 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2f71ec36-01a5-4576-8d7c-aab2397ca2ec req-2ab459f5-4f46-4f9c-a4d8-6774463cd054 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 932 time: 1.5482266 May 25 15:41:38.502158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=6f262988-6838-4979-94fe-63855563e32b,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:38.542016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.343s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:38.549922 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-86fc618a-282b-4edf-92db-3c579b5833bd req-e1baa092-f7dc-4f11-af41-bc5cb0021656 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:38.554254 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-86fc618a-282b-4edf-92db-3c579b5833bd req-e1baa092-f7dc-4f11-af41-bc5cb0021656 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 932 time: 2.0455217 May 25 15:41:38.626897 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-e0f57363-b48c-4547-b3f3-9db0c965e7da None None] Port 6d2d8f03-a534-4b34-94da-7da100d11936 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:38.659226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.661373 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:41:38.665215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.674605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-34620065-604a-4e98-b4ee-79074a9a2921 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:38.706041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8be209b-9b5c-4a1b-931a-7164e6577ed0,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:38.711403 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-2f71ec36-01a5-4576-8d7c-aab2397ca2ec req-c4e0ad09-5710-4057-9387-c618a62185d1 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Synchronizing usage tracker for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:38.719447 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:38.789335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.798158 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-86fc618a-282b-4edf-92db-3c579b5833bd req-0d8a71be-ef65-4018-af6a-742f79a7b096 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2172072 May 25 15:41:38.819156 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 57114f18-b5af-4c03-b3c4-d90bf7703373, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=57114f18-b5af-4c03-b3c4-d90bf7703373,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:38.830303 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Allocated IP 172.20.0.1 (e2c8de13-6b38-480d-a253-7798199b43d7/0eddaf48-c485-4fd6-aa56-c8209ff2711a/f5c01938-0a49-4160-8b18-b2c171ad66ac) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:38.834463 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.835864 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a8be209b-9b5c-4a1b-931a-7164e6577ed0 HTTP/1.1" status: 204 len: 168 time: 2.6762476 May 25 15:41:38.843826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.867879 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-2f71ec36-01a5-4576-8d7c-aab2397ca2ec req-c4e0ad09-5710-4057-9387-c618a62185d1 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Unset dirty status for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:38.868728 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2f71ec36-01a5-4576-8d7c-aab2397ca2ec req-c4e0ad09-5710-4057-9387-c618a62185d1 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3751543 May 25 15:41:38.880007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:38.884407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:38.963355 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.000462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:41:39.026796 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-4d09472d-32a5-47e8-8b2b-e9513ab512df None None] Provisioning complete for port 15d1697c-ee7f-4919-b595-da6a79fd36cc triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:39.027265 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4d09472d-32a5-47e8-8b2b-e9513ab512df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.047661 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.079251 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:39.089324 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] 10.222.0.25 "PUT /v2.0/routers/1010794f-cc62-4f17-9bac-e4a39ed5d7a5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.9051003 May 25 15:41:39.166143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-4d09472d-32a5-47e8-8b2b-e9513ab512df None None] Port 15d1697c-ee7f-4919-b595-da6a79fd36cc cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:39.168211 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:39.176628 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6f262988-6838-4979-94fe-63855563e32b up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:39.319595 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=57114f18-b5af-4c03-b3c4-d90bf7703373,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:39.331257 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:39.332286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:39.336984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] vlan segment allocate from pool success with {'vlan_id': 809, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:41:39.348004 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.348346 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Added segment 2c62ffb7-4535-48d2-a122-c204bfad0c49 of type vlan for network eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 May 25 15:41:39.383475 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.401066 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.517s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:39.560783 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 6f262988-6838-4979-94fe-63855563e32b triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:39.560783 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.586128 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:39.588628 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:39.598823 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:39.630645 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62b21947-ed7d-446e-85ee-48a912303760,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:39.641462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.642386 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:39.644346 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:39.661799 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:39.672725 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:39.673244 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:39.715320 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:39.727141 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e2650e29-7287-4a2a-bb2e-a53d9175b14d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:39.758789 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] 10.222.0.25 "PUT /v2.0/routers/e15748c9-8f60-49f9-a768-dc9676a5b123/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.3645713 May 25 15:41:39.766638 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.4448431 May 25 15:41:39.769433 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54266) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:39.777355 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Request body: {'subnet': {'network_id': 'eba4f7c8-bde3-4fe9-93b9-23e2a7071f03', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1320605035-subnet', 'tenant_id': '203eb789c3e9438eab0ccb525ad70c17', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:39.784636 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:39.797076 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Usage tracker for resource:subnet and tenant:203eb789c3e9438eab0ccb525ad70c17 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:39.804418 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:39.818668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:39.849541 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Made reservation on behalf of 203eb789c3e9438eab0ccb525ad70c17 for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:39.852262 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.058005 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Pushing event updated for resources: {'Network': ['ID=eba4f7c8-bde3-4fe9-93b9-23e2a7071f03,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:40.073585 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:40.075383 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:40.077833 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.142106 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20ad01c8-0c68-48eb-9a40-18a2706e6686 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:40.147743 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:41:40.211519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b35a774-89b1-4809-b28b-1deeafa0856b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:40.238544 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.249481 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:40.270311 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.273212 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2b35a774-89b1-4809-b28b-1deeafa0856b HTTP/1.1" status: 204 len: 168 time: 1.9186645 May 25 15:41:40.351764 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54284) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:40.370459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group': {'name': 'tempest-securitygroup--980691275', 'description': 'tempest-description--1926107296'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:40.391323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.400180 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:40.409904 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:40.466121 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:40.521111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:40.549472 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:40.606011 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Pushing event updated for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:40.625191 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:40.651802 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Network e2c8de13-6b38-480d-a253-7798199b43d7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:40.652995 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:40.664503 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:40.666314 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.725862 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.729790 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:36Z', 'revision_number': 2, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:40.738386 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:40.738746 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Updating router e15748c9-8f60-49f9-a768-dc9676a5b123 port 15d1697c-ee7f-4919-b595-da6a79fd36cc binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:40.788570 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad673f6-e7e4-4bde-b4b3-547c8c1171b1 req-a41e62c3-36ef-4542-baf6-4de637be258b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:40.796160 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0ad673f6-e7e4-4bde-b4b3-547c8c1171b1 req-a41e62c3-36ef-4542-baf6-4de637be258b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 932 time: 0.5951521 May 25 15:41:40.881395 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.924011 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:40.930980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.950798 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:40.971815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:41.011591 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:41.087573 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0ad673f6-e7e4-4bde-b4b3-547c8c1171b1 req-6778d859-af1a-4ab3-9edd-03b60f990db2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2708719 May 25 15:41:41.099848 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:35Z', 'revision_number': 2, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:41.129619 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:41.129946 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Updating router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 port 6d2d8f03-a534-4b34-94da-7da100d11936 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:41.147609 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dbf126e-6b0a-4f77-b40f-135b9168beb2 req-691ea928-4fdf-4f28-be0d-60a9c8e44dd2 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:41.157933 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1dbf126e-6b0a-4f77-b40f-135b9168beb2 req-691ea928-4fdf-4f28-be0d-60a9c8e44dd2 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 932 time: 0.5289996 May 25 15:41:41.266967 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.287872 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 57114f18-b5af-4c03-b3c4-d90bf7703373 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:41.417169 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.424354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.426358 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.433498 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:41.456604 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1dbf126e-6b0a-4f77-b40f-135b9168beb2 req-2269161c-aa55-4fad-b977-42b99e4c118c tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2400792 May 25 15:41:41.560656 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.602511 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.618259 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Pushing event updated for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:41.623486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:41.761914 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.775704 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Transition to ACTIVE for port object 15d1697c-ee7f-4919-b595-da6a79fd36cc will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:41.784463 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7108c974-ab52-402d-a981-8d802a2e8356 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:41.787366 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.794053 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:41.885837 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Network e2c8de13-6b38-480d-a253-7798199b43d7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:41.887207 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:41.969839 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 57114f18-b5af-4c03-b3c4-d90bf7703373 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:41.970232 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.010440 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.071146 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-bb52218c-12fe-40a2-bcdc-26e6411bb8e4 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98391) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:41:42.072464 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-bb52218c-12fe-40a2-bcdc-26e6411bb8e4 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0306137 May 25 15:41:42.074292 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ded7460c-4a06-481d-9879-887b2520ce54,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.081371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:42.084824 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.088814 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Transition to ACTIVE for port object 6d2d8f03-a534-4b34-94da-7da100d11936 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:42.092473 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 1.7322645 May 25 15:41:42.095075 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54318) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:42.108114 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.121195 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:42.144148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-9ce86776-186e-49af-9b3f-a64918399b8e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:41:42.145199 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-9ce86776-186e-49af-9b3f-a64918399b8e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0266781 May 25 15:41:42.156988 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a83e3d-a0da-400b-8446-38860780721f None None] Pushing event updated for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.169263 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group_rule': {'security_group_id': 'ded7460c-4a06-481d-9879-887b2520ce54', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:42.173119 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-52a83e3d-a0da-400b-8446-38860780721f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.379s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:42.240824 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:42.290385 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:42.314349 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:42.368228 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:42.383007 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.457967 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Attempting to bind port 15d1697c-ee7f-4919-b595-da6a79fd36cc on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:42.457967 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Attempting to bind port 15d1697c-ee7f-4919-b595-da6a79fd36cc by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:42.457967 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Attempting to bind port 15d1697c-ee7f-4919-b595-da6a79fd36cc on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:42.473739 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:42.474113 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Checking segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:42.474528 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.474929 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Bound using segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:42.475421 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Bound port: 15d1697c-ee7f-4919-b595-da6a79fd36cc, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:42.475825 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.525357 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:42.578119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:41:42.628791 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.733128 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.747899 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] For port 15d1697c-ee7f-4919-b595-da6a79fd36cc, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:42.751092 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.764507 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] For port 15d1697c-ee7f-4919-b595-da6a79fd36cc, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=15d1697c-ee7f-4919-b595-da6a79fd36cc,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:42.776025 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.795593 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Pushing event updated for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.829291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-423418cd-aac8-49a0-b297-f404b08329d3 req-03568711-09a6-442f-a4d3-f980846e1a51 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:42.831530 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-423418cd-aac8-49a0-b297-f404b08329d3 req-03568711-09a6-442f-a4d3-f980846e1a51 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 932 time: 0.4461060 May 25 15:41:42.834293 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:42.849620 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.728s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:42.859681 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Checking segment: {'id': '2c62ffb7-4535-48d2-a122-c204bfad0c49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 809, 'network_id': 'eba4f7c8-bde3-4fe9-93b9-23e2a7071f03'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:42.860239 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Network hostable DHCP agents. Network: eba4f7c8-bde3-4fe9-93b9-23e2a7071f03, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:42.888934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.890426 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7705986 May 25 15:41:42.896216 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54338) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:42.912723 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dbfa2464-b9f9-484a-8e55-b31ae904264c,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.918464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group_rule': {'security_group_id': 'ded7460c-4a06-481d-9879-887b2520ce54', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:42.931757 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:42.936912 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:42.940468 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:42.948610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:43.009143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.483s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:43.010222 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Attempting to bind port 6d2d8f03-a534-4b34-94da-7da100d11936 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:43.010379 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.012349 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Attempting to bind port 6d2d8f03-a534-4b34-94da-7da100d11936 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:43.013469 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Attempting to bind port 6d2d8f03-a534-4b34-94da-7da100d11936 on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:43.021369 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.234s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:43.028094 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:43.032976 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Checking segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:43.033532 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.034865 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Bound using segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:43.035387 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Bound port: 6d2d8f03-a534-4b34-94da-7da100d11936, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:43.037501 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.100166 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54342) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:43.139457 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1071154787', 'description': 'tempest-description--267406357'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:43.161539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:43.179159 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:43.188719 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:43.191906 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:43.193204 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:43.215315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:43.319115 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:43.325419 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] For port 6d2d8f03-a534-4b34-94da-7da100d11936, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:43.330914 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] For port 6d2d8f03-a534-4b34-94da-7da100d11936, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6d2d8f03-a534-4b34-94da-7da100d11936,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:43.336711 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Sync routers for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:43.350910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.351204 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] 10.222.0.25 "PUT /v2.0/routers/15be0d6a-9ac8-468d-a5d9-0a6d6ce95956/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.5774262 May 25 15:41:43.351204 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.376590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:43.404024 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a83e3d-a0da-400b-8446-38860780721f None None] Pushing event updated for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:43.409287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Network eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:43.410500 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:43.419923 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:43.432592 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:43.440328 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:43.455747 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-423418cd-aac8-49a0-b297-f404b08329d3 req-27b3c197-ce90-4ed6-b4a5-212fb70ff5e8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5862162 May 25 15:41:43.519788 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-52a83e3d-a0da-400b-8446-38860780721f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.685s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:43.561018 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:43.569515 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:43.624097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7257bb4d-a8fa-4e8f-b2a9-661a7cbf7ebb,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:43.633336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, eba4f7c8-bde3-4fe9-93b9-23e2a7071f03) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:43.670920 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.671421 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:43.672318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.693015 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.722908 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.701s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:43.753445 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:43.789889 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.791126 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.6899173 May 25 15:41:43.799157 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54370) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:43.818370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group_rule': {'security_group_id': '5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:43.858087 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9a182c6-4fbe-43e4-b9d6-6d487e86aede None None] Network eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:43.861176 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:43.925736 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.931339 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 4.1607759 May 25 15:41:43.941481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:43.954680 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:43.958488 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:43.972874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:43.973068 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a3aea2c0-9e84-4bfc-85b1-149630acf876 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:43.989475 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:43.993295 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:44.036335 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f153e369-b4a0-4261-9f6b-e3676f679758,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:44.040293 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:44.054712 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.062249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89580cf-9a63-4962-acad-49b933929ab6 req-cf2a6438-e7a9-4af7-9335-92515bfc60a5 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:44.064247 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b89580cf-9a63-4962-acad-49b933929ab6 req-cf2a6438-e7a9-4af7-9335-92515bfc60a5 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 932 time: 0.7070675 May 25 15:41:44.065584 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.069742 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1660316 May 25 15:41:44.070203 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54380) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:44.075942 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:44.085955 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:44.087481 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:44.098268 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:44.114589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:44.124300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:floatingip and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:44.138221 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:44.156247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:44.165933 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b89580cf-9a63-4962-acad-49b933929ab6 req-899249e6-a74a-462f-85bc-67c65459cdf3 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903301 May 25 15:41:44.182748 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.269472 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.275130 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.277990 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:44.339437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=83cfa682-3769-4943-9b57-2dd439ca6217,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:44.361096 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:44.392322 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.393771 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5937254 May 25 15:41:44.396355 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54388) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:44.401845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group_rule': {'security_group_id': '5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:44.418317 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:44.423847 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Request body: {'port': {'device_id': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:44.425845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:44.428939 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:44.447766 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:44.477307 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Pushing event updated for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:44.480994 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.494108 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.118s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:44.619341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.664960 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54400) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:44.707351 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54406) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:44.822475 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.822690 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.851317 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.864443 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:44.924004 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=433dece4-7daa-412c-b632-0a4088f19f03,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:44.926654 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:42Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:44.932552 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cf5f2ac-7c2b-45bc-b5e5-a8ef4f441e79 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:42Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:44.942394 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:44.945978 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Deleting subnet 1df599fc-b5f5-4a3c-94e4-e251fe71de2c {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:41:44.949287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.951024 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5529776 May 25 15:41:44.961310 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:44.990934 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:45.023691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54412) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:45.061572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:45.090184 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:45.114434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:floatingip and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:45.119490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:45.132826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:45.152273 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.171877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Request body: {'port': {'device_id': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:45.245110 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.291747 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 15d1697c-ee7f-4919-b595-da6a79fd36cc up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:45.292321 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.344914 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:45.412623 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.532849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-80b9eef0-b2c2-4dfd-80c4-1685c4cfb417 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:45.533517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-79ac86b9-c034-417c-b52e-2770c18770bf req-80b9eef0-b2c2-4dfd-80c4-1685c4cfb417 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Synchronizing usage tracker for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:45.702482 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 47cc10ba-9942-4817-9ec9-0b0bdaf65164 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:45.711126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.729785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Transition to ACTIVE for port object 47cc10ba-9942-4817-9ec9-0b0bdaf65164 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:45.732186 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:45.754071 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b744203-40fb-4bc1-9317-ff8ff792beed None None] Network eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:45.783770 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.825166 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Usage tracker for resource:security_group_rule and tenant:8173a10e0aba49fbadb5a4e5dd51ee3a is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:45.834888 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:45.853356 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:45.868100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:45.886763 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-619acfd1-0abf-46bf-ae28-174b216a6294 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:45.980406 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Allocated IP 172.27.1.100 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/af349efd-a083-4d04-bc3d-bcce005d9daf) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:46.091655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Pushing event updated for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:46.131238 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:40Z', 'revision_number': 4, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'f5c01938-0a49-4160-8b18-b2c171ad66ac', 'name': '', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'mac_address': 'fa:16:3e:d1:59:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:38Z', 'updated_at': '2021-05-25T15:41:41Z', 'revision_number': 2, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'subnets': [{'id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:46.133606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4caf4cfa-2276-485a-88ff-d5769a1a9e5b req-0a14e397-8468-4967-ba4e-182715d5230e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:46.140232 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Checking router: 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:46.140727 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Updating router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 port f5c01938-0a49-4160-8b18-b2c171ad66ac binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:46.140878 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4caf4cfa-2276-485a-88ff-d5769a1a9e5b req-0a14e397-8468-4967-ba4e-182715d5230e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 932 time: 1.3061268 May 25 15:41:46.154940 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:46.201430 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.268432 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.330557 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.354246 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 15d1697c-ee7f-4919-b595-da6a79fd36cc completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:46.359382 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:46.370410 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 15d1697c-ee7f-4919-b595-da6a79fd36cc triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:46.371649 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.372785 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.417913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1df599fc-b5f5-4a3c-94e4-e251fe71de2c,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:46.445556 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:46.524717 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4caf4cfa-2276-485a-88ff-d5769a1a9e5b req-32102dd5-7f2c-448d-b09a-7c18e3c6da52 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3829513 May 25 15:41:46.525716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.545781 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.556368 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:46.579034 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/1df599fc-b5f5-4a3c-94e4-e251fe71de2c HTTP/1.1" status: 204 len: 168 time: 1.8592155 May 25 15:41:46.583249 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54448) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:46.620480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:46.635856 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:46.641868 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Attempting to bind port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:46.642226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Attempting to bind port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '12684b13-b98f-4241-9d70-842214716852', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '93554588-43bc-41aa-b595-47bd440305fb'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:46.642586 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Attempting to bind port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 on network 93554588-43bc-41aa-b595-47bd440305fb {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:46.673191 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:46.724516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 on network 93554588-43bc-41aa-b595-47bd440305fb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:41:46.725234 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Attempting to bind port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 on network 93554588-43bc-41aa-b595-47bd440305fb {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:46.760800 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Allocated IP 172.27.1.232 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/48fdd9f0-791c-40da-bbfa-08a554d91e18) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:46.773567 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:46.785730 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.798053 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:46.798258 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Checking segment: {'id': '12684b13-b98f-4241-9d70-842214716852', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '93554588-43bc-41aa-b595-47bd440305fb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:46.798930 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Bound using segment: {'id': '12684b13-b98f-4241-9d70-842214716852', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '93554588-43bc-41aa-b595-47bd440305fb'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:46.799427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Bound port: 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12684b13-b98f-4241-9d70-842214716852', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '93554588-43bc-41aa-b595-47bd440305fb'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:46.799812 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.877405 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.879875 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Transition to ACTIVE for port object 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:46.938314 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=af349efd-a083-4d04-bc3d-bcce005d9daf,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:46.941166 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.963349 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.407s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:46.964328 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.967516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.973792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:43Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:46.984884 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-096a9327-dc35-442c-9866-e4df0da3d219 None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:43Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:46.987302 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:46.994030 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:46.995580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.037834 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 15d1697c-ee7f-4919-b595-da6a79fd36cc, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=15d1697c-ee7f-4919-b595-da6a79fd36cc,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:47.049034 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.068592 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.118183 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.136081 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-79ac86b9-c034-417c-b52e-2770c18770bf req-80b9eef0-b2c2-4dfd-80c4-1685c4cfb417 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Unset dirty status for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:47.137172 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-80b9eef0-b2c2-4dfd-80c4-1685c4cfb417 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 818 time: 1.9639211 May 25 15:41:47.192861 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.228224 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Pushing event updated for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:47.256018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:47.281894 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.282987 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:47.287703 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19c935d-401a-4b8c-862f-4f51205a23fe req-90cdb007-648b-47c5-a543-f196588db0f3 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:47.289640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b19c935d-401a-4b8c-862f-4f51205a23fe req-90cdb007-648b-47c5-a543-f196588db0f3 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 944 time: 0.5457909 May 25 15:41:47.309276 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.313080 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8651c3a-be5c-450a-9d04-dfdeb45e031b,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:47.323909 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Transition to ACTIVE for port object f5c01938-0a49-4160-8b18-b2c171ad66ac will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:47.328727 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:47.332654 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:47.333230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:47.337153 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-e516b6ff-c5a5-4f02-b6ef-9b694851b9da tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/quotas/53352f5306c64e2191fc3770c3f34cb6 HTTP/1.1" status: 200 len: 375 time: 0.1635673 May 25 15:41:47.345348 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8173a10e0aba49fbadb5a4e5dd51ee3a&name=default HTTP/1.1" status: 200 len: 2979 time: 2.6715105 May 25 15:41:47.345348 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.348271 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.354568 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.400528 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.403597 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54462) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:47.419779 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.419779 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.420517 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.420862 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > port after_create 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.421207 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > port after_delete 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.421564 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > port after_update 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.421889 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.422209 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.422535 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.422840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.583011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Pushing event updated for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:47.586020 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:47.636153 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164,segment=NetworkSegment(12684b13-b98f-4241-9d70-842214716852),segment_id=12684b13-b98f-4241-9d70-842214716852)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:47.670685 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.689412 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Attempting to bind port f5c01938-0a49-4160-8b18-b2c171ad66ac on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:47.689681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Attempting to bind port f5c01938-0a49-4160-8b18-b2c171ad66ac by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:47.690277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Attempting to bind port f5c01938-0a49-4160-8b18-b2c171ad66ac on network e2c8de13-6b38-480d-a253-7798199b43d7 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:47.698238 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:47.698477 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Checking segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:47.698982 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.699493 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Bound using segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:47.701171 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Bound port: f5c01938-0a49-4160-8b18-b2c171ad66ac, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:47.702625 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.713736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.713736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.714090 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.714420 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98391) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:47.714790 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:47.728052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.803462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ed2fbbe2-249b-47a1-8db7-6ccd712714a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.815542 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b19c935d-401a-4b8c-862f-4f51205a23fe req-bfc995e4-8df7-4d3d-82ea-f40c53977030 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4127851 May 25 15:41:47.835500 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5306959-4a34-46e9-bfbe-42c43ed590c4') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:47.835819 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5306959-4a34-46e9-bfbe-42c43ed590c4') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:47.864081 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] For port f5c01938-0a49-4160-8b18-b2c171ad66ac, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:47.871938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] For port f5c01938-0a49-4160-8b18-b2c171ad66ac, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=f5c01938-0a49-4160-8b18-b2c171ad66ac,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:47.883434 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:47.884306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.886006 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] 10.222.0.74 "PUT /v2.0/ports/47cc10ba-9942-4817-9ec9-0b0bdaf65164 HTTP/1.1" status: 200 len: 1094 time: 4.1853518 May 25 15:41:47.890861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.897122 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:47.901599 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:47.937869 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:47.940633 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:47.955726 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:47.958541 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:47.993358 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Attempting to bind port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:47.993717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Attempting to bind port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:47.994087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Attempting to bind port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:48.015442 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.072102 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:48.072875 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:41:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:48.078013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=48fdd9f0-791c-40da-bbfa-08a554d91e18,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.081573 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:48.082373 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:41:48.082712 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Attempting to bind port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:48.097369 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:48.097733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Checking segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:48.098286 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Bound using segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:48.098780 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Bound port: 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:48.099129 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.117771 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Releasing vlan 828 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:41:48.118391 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: from cryptography.utils import int_from_bytes May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: from cryptography.utils import int_from_bytes May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:41:48.137627 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:41:48.155053 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54478) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:48.171675 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.203241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Pushing event updated for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.213303 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:48.258678 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Pushing event updated for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.299657 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.572s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:48.304561 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-6fe7479f-7962-4eb6-a94d-9ec9326df123 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&fields=id HTTP/1.1" status: 200 len: 255 time: 0.9108586 May 25 15:41:48.305890 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.db.resource_extend [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:41:48.350783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.397433 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.420521 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:48.445832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.484873 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.486823 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.492246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-565d722f-cf32-46c3-8b92-511ee93cf714 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:48.504724 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.517002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cdded13-175d-44a6-9cc5-97788122b7a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:48.533477 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] 10.222.0.25 "DELETE /v2.0/networks/fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57 HTTP/1.1" status: 204 len: 168 time: 1.9177592 May 25 15:41:48.557047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54492) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:48.581600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Pushing event deleted for resources: {'Network': ['ID=fa2a7323-3dd0-45c4-8fa1-ddcdce8f3c57,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.584905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:48.620012 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.660254 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.716320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.730390 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=af349efd-a083-4d04-bc3d-bcce005d9daf,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.736434 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:48.753018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Deleting subnet dbfa2464-b9f9-484a-8e55-b31ae904264c {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:41:48.772030 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.772671 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:40Z', 'revision_number': 4, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'f5c01938-0a49-4160-8b18-b2c171ad66ac', 'name': '', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'mac_address': 'fa:16:3e:d1:59:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:38Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 4, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'subnets': [{'id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:48.774719 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:48.777334 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-286df78f-dc69-4d5e-81f6-18fcc46de8ee None None] The sync data for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi is: [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T15:41:40Z', 'revision_number': 4, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'f5c01938-0a49-4160-8b18-b2c171ad66ac', 'name': '', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'mac_address': 'fa:16:3e:d1:59:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_interface', 'standard_attr_id': 107, 'fixed_ips': [{'subnet_id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:38Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 4, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'subnets': [{'id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:48.807020 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:48.819094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-ad7f9ecc-96a3-4a93-b5dc-4be68e41b2e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:48.820514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.820704 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-ad7f9ecc-96a3-4a93-b5dc-4be68e41b2e3 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=4d321f2af3214e7d853ab4248bfea864&device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 1097 time: 0.7766337 May 25 15:41:48.841709 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:48.869516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:48.939040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:48.939856 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:48.941507 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] 10.222.0.74 "PUT /v2.0/ports/0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 1094 time: 3.7845123 May 25 15:41:48.947256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:48.980411 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Pushing event updated for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:48.992564 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:49.020984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.027963 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.035527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7d657ea7-fe11-43d3-a990-39777b006338 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:49.064224 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Usage tracker for resource:security_group_rule and tenant:c5a86cc1bc6242aaab8411a3a5098329 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:49.085365 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:49.116909 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-d702c642-09f2-44a8-92e2-659f5f706abc service neutron] 10.222.0.25 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7824912 May 25 15:41:49.124643 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:49.185427 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-cea4e60b-1a92-4e26-bc06-8bcb713c9b52 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164 HTTP/1.1" status: 200 len: 217 time: 0.2881329 May 25 15:41:49.189120 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.201439 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.219513 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.1316452 May 25 15:41:49.219513 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9a99a6-413f-4321-9fff-266d086e2a84 req-1bf4ee47-71d7-4b06-b800-8ba2cf5b0d7a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:49.231525 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ff9a99a6-413f-4321-9fff-266d086e2a84 req-1bf4ee47-71d7-4b06-b800-8ba2cf5b0d7a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 944 time: 1.0728278 May 25 15:41:49.334373 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=48fdd9f0-791c-40da-bbfa-08a554d91e18,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:49.345356 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.311s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:49.378241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device f5c01938-0a49-4160-8b18-b2c171ad66ac up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:49.389663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.410556 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-4cc7aa8c-85a6-4eb8-b49d-ad1edd815afc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:49.412896 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-4cc7aa8c-85a6-4eb8-b49d-ad1edd815afc service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1097 time: 0.2691000 May 25 15:41:49.425897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.440333 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.4059153 May 25 15:41:49.451272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.513847 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port f5c01938-0a49-4160-8b18-b2c171ad66ac completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:49.534580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port f5c01938-0a49-4160-8b18-b2c171ad66ac triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:49.537785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.542578 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-58d35e9d-ff75-4709-87d0-725cc7977156 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.1101656 May 25 15:41:49.542738 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.582542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:49.633305 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8651c3a-be5c-450a-9d04-dfdeb45e031b,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:49.642595 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:49.653142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.654829 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a8651c3a-be5c-450a-9d04-dfdeb45e031b HTTP/1.1" status: 204 len: 168 time: 2.2496667 May 25 15:41:49.758604 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-0123273e-635f-4103-9f49-4fdcea2cf106 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:49.759037 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-9b6d8871-666d-4787-9567-300f52feba8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:49.760281 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-0123273e-635f-4103-9f49-4fdcea2cf106 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.2027655 May 25 15:41:49.760478 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-9b6d8871-666d-4787-9567-300f52feba8f service neutron] 10.222.0.74 "GET /v2.0/subnets?id=109089f6-966f-46c3-ac4d-c0610e95a24b HTTP/1.1" status: 200 len: 852 time: 0.5143261 May 25 15:41:49.763726 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ff9a99a6-413f-4321-9fff-266d086e2a84 req-edacf11f-27d9-4b54-a1ab-870b04dbdb1c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5306020 May 25 15:41:49.850607 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.863502 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-948205bb-fdb6-4adc-98bc-b57b79fa4813 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=93554588-43bc-41aa-b595-47bd440305fb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0818021 May 25 15:41:49.865741 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-b2b19684-8c51-4e4c-a56b-6eeab2b6215c service neutron] 10.222.0.25 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7116530 May 25 15:41:49.954247 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-e509ea28-5cec-4396-af41-d1f0f6c0ae45 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1764295 May 25 15:41:49.962032 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port f5c01938-0a49-4160-8b18-b2c171ad66ac, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=f5c01938-0a49-4160-8b18-b2c171ad66ac,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:49.974115 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:49.977034 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6d2d8f03-a534-4b34-94da-7da100d11936 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:50.079849 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.145621 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.181951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.222217 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.234947 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-77f97895-142b-425a-ac76-6f0bffa9284d service neutron] 10.222.0.74 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3613126 May 25 15:41:50.365463 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c5a86cc1bc6242aaab8411a3a5098329&name=default HTTP/1.1" status: 200 len: 2979 time: 2.2048602 May 25 15:41:50.371808 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-32241928-4b25-4799-b4df-8a426ded46ff service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4034252 May 25 15:41:50.376789 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54520) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:50.390775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=408b04aa-0da0-4823-8537-e2935441b460,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:50.394278 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.406801 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.453460 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:50.463157 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6f849e87-4f7e-4b54-8ed9-6e45413d8c65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.488726 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.545828 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164', 'status': 'completed', 'code': 200} May 25 15:41:50.566410 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dbfa2464-b9f9-484a-8e55-b31ae904264c,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:50.572772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.594430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.620797 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 6d2d8f03-a534-4b34-94da-7da100d11936 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:50.627218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbb10059-99e1-439a-b6d3-590d24e62699 req-3e9d8637-c6cc-49a7-82b0-7f5df3127b25 service neutron] 10.222.0.74 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3773737 May 25 15:41:50.633078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 6d2d8f03-a534-4b34-94da-7da100d11936 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:50.635037 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/dbfa2464-b9f9-484a-8e55-b31ae904264c HTTP/1.1" status: 204 len: 168 time: 2.0361443 May 25 15:41:50.636239 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.639816 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54532) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:50.907622 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'status': 'completed', 'code': 200} May 25 15:41:50.936267 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.003324 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 6d2d8f03-a534-4b34-94da-7da100d11936, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6d2d8f03-a534-4b34-94da-7da100d11936,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:51.012624 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54546) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:51.013982 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.014740 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 15d1697c-ee7f-4919-b595-da6a79fd36cc up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:51.071712 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.092264 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.126572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.151841 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-8ff48460-469a-4a67-91a5-3ad79445901d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:51.158593 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-01d52ee6-507c-4728-9a8b-38b10f28bdcc req-a4d1246b-b9ea-45ac-952e-c596e5c50a92 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7418661 May 25 15:41:51.177015 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:51.191697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Usage tracker for resource:security_group_rule and tenant:88ccd1842f6c4f8684e1fb15534fd2fa is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:51.198219 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:51.203228 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.213337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.224730 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.229928 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:51.242398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 15d1697c-ee7f-4919-b595-da6a79fd36cc triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:51.243158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.256457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db57f508-11a4-48cf-9fd3-be5088771039 req-1ec43a00-aabf-4034-95dc-8932c5984e0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.258090 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-1ec43a00-aabf-4034-95dc-8932c5984e0b service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=4d321f2af3214e7d853ab4248bfea864&device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 1097 time: 0.4708273 May 25 15:41:51.264136 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.265572 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-8ff48460-469a-4a67-91a5-3ad79445901d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:51.266915 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-8ff48460-469a-4a67-91a5-3ad79445901d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--980691275&fields=id&tenant_id=0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 267 time: 0.2156949 May 25 15:41:51.496567 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.520776 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device f5c01938-0a49-4160-8b18-b2c171ad66ac up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:51.521603 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.550540 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=408b04aa-0da0-4823-8537-e2935441b460,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.555518 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.563247 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-8eb344e1-024b-4318-a16f-8fa8b2f65d7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.565307 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-8eb344e1-024b-4318-a16f-8fa8b2f65d7a service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1097 time: 0.2309821 May 25 15:41:51.568243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.584136 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.605304 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.611285 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port f5c01938-0a49-4160-8b18-b2c171ad66ac triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:51.611824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.629684 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ca4e4c-ed53-473c-a0e6-c5e0eeda3b94 req-67d2f49f-43d3-4dba-9910-318e78a45131 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.631052 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-98ca4e4c-ed53-473c-a0e6-c5e0eeda3b94 req-67d2f49f-43d3-4dba-9910-318e78a45131 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 944 time: 0.6961744 May 25 15:41:51.646846 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.647210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.647975 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.648320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > port after_create 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.648644 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > port after_delete 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.648992 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > port after_update 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.649308 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.649670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.650232 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.650704 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.732247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.732608 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.732943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.733288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98392) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:41:51.733642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eba4f7c8-bde3-4fe9-93b9-23e2a7071f03']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:51.738461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.739927 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/408b04aa-0da0-4823-8537-e2935441b460 HTTP/1.1" status: 204 len: 168 time: 1.3586986 May 25 15:41:51.744736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.817239 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6d2d8f03-a534-4b34-94da-7da100d11936 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:51.930010 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 6d2d8f03-a534-4b34-94da-7da100d11936 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:51.930540 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.964633 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-2ed1fe23-5ffc-4a1f-96b7-82f4551312d5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.965449 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-2ed1fe23-5ffc-4a1f-96b7-82f4551312d5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:51.980582 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2c62ffb7-4535-48d2-a122-c204bfad0c49') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:51.980967 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2c62ffb7-4535-48d2-a122-c204bfad0c49') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:51.983007 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=88ccd1842f6c4f8684e1fb15534fd2fa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9012449 May 25 15:41:51.985118 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54558) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:52.004148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.005558 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=686c0ad6-72e1-4e48-95ea-42b5cc78748e,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:52.050384 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.063416 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.067639 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-2b50d876-f42b-4667-ac30-ccb0bcb91d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.068265 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db57f508-11a4-48cf-9fd3-be5088771039 req-38048782-d884-432d-a84c-c2dcc57fae18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.069721 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-38048782-d884-432d-a84c-c2dcc57fae18 service neutron] 10.222.0.74 "GET /v2.0/networks?id=93554588-43bc-41aa-b595-47bd440305fb HTTP/1.1" status: 200 len: 913 time: 0.7221093 May 25 15:41:52.070342 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-2b50d876-f42b-4667-ac30-ccb0bcb91d0c service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.4836390 May 25 15:41:52.102052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Releasing vlan 809 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:41:52.102804 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.123171 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-98ca4e4c-ed53-473c-a0e6-c5e0eeda3b94 req-dd7cee70-a3d9-4a78-8605-7b4d872dd436 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3813221 May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: from cryptography.utils import int_from_bytes May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: from cryptography.utils import int_from_bytes May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:41:52.126174 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:41:52.214330 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-a7357562-ecd7-4cc5-93c3-07e8376a5fec service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.1133776 May 25 15:41:52.265019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-2ed1fe23-5ffc-4a1f-96b7-82f4551312d5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:52.271253 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-2ed1fe23-5ffc-4a1f-96b7-82f4551312d5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 810 time: 0.9516187 May 25 15:41:52.273769 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-ccaa64b0-ed8e-4e95-a037-11473b55fdda service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164 HTTP/1.1" status: 200 len: 217 time: 0.1733830 May 25 15:41:52.289748 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.291397 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54572) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:52.294847 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-ee43f3fa-f859-47c9-9bc7-771bdb31273e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/quotas/0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 375 time: 0.0218849 May 25 15:41:52.303789 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-ac8e932a-8822-4e0c-95b5-6b0cab770e18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.305185 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-ac8e932a-8822-4e0c-95b5-6b0cab770e18 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0798116 May 25 15:41:52.374437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.388597 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-148c5d91-0ac5-4de8-a8b9-f0faa5f5407e service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0689659 May 25 15:41:52.391598 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.404981 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:52.436931 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Usage tracker for resource:security_group_rule and tenant:c0251bdcdf59462a9c445346e1a63064 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:52.445496 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:52.486027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.517232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:52.524362 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-66c29bb7-7f2e-4a17-819f-230f63e98ae4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--1071154787&fields=id&tenant_id=dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 267 time: 0.2430503 May 25 15:41:52.531959 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.538486 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.558345 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db57f508-11a4-48cf-9fd3-be5088771039 req-6f93b2d9-2582-4a23-8f01-382284e9c7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.559972 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-6f93b2d9-2582-4a23-8f01-382284e9c7b3 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=109089f6-966f-46c3-ac4d-c0610e95a24b HTTP/1.1" status: 200 len: 852 time: 0.2637358 May 25 15:41:52.588205 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Pushing event deleted for resources: {'Network': ['ID=eba4f7c8-bde3-4fe9-93b9-23e2a7071f03,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:52.592818 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.605306 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ac0f3b7f-ca9d-46cd-a193-f6db4211f5bd admin admin] 10.222.0.25 "DELETE /v2.0/networks/eba4f7c8-bde3-4fe9-93b9-23e2a7071f03 HTTP/1.1" status: 204 len: 168 time: 1.9621441 May 25 15:41:52.630032 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:52.644737 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.74', 61726) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:52.698494 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.769372 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-58a02944-3620-422c-a9d7-733ba15d5a90 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=93554588-43bc-41aa-b595-47bd440305fb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1725073 May 25 15:41:52.798431 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-be7de2df-a382-438b-bfb0-842a31f04541 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3950171 May 25 15:41:52.813145 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=686c0ad6-72e1-4e48-95ea-42b5cc78748e,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:52.864491 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.874542 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54580) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:52.933987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-6dddf6a4-598b-4ebd-9163-57d90b9ef1e5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:52.970701 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-829e8182-00b7-4374-99be-6fa3937d9f6f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.972184 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-829e8182-00b7-4374-99be-6fa3937d9f6f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 817 time: 0.4190171 May 25 15:41:53.002978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-6dddf6a4-598b-4ebd-9163-57d90b9ef1e5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:53.004288 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-6dddf6a4-598b-4ebd-9163-57d90b9ef1e5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.6807835 May 25 15:41:53.006991 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.007990 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-6fe6c0a9-92ef-4e9d-ac7a-5ef95b7b6054 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/quotas/dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 375 time: 0.0276799 May 25 15:41:53.009820 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-8531c0b4-c86c-41f0-addd-71513b6356d5 service neutron] 10.222.0.74 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2137723 May 25 15:41:53.012318 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/686c0ad6-72e1-4e48-95ea-42b5cc78748e HTTP/1.1" status: 204 len: 168 time: 1.0220859 May 25 15:41:53.142840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.182545 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.216123 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-a699cee7-8a53-4c51-8060-01055ab6c35d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.218277 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-a699cee7-8a53-4c51-8060-01055ab6c35d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 818 time: 0.5722406 May 25 15:41:53.225121 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e78f67e6-e452-4f14-bd1e-64b459ee1e91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.239175 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-da445568-3994-4e8d-8e13-5b090bc89687 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=fe9c838cd1824cbe93a14ad56eb903e6&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3542054 May 25 15:41:53.240863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54594) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:53.267157 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Request body: {'port': {'device_id': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'admin_state_up': True, 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:53.367142 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-a190aee8-66ae-4358-b48a-fb911001defa service neutron] 10.222.0.25 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3441465 May 25 15:41:53.413368 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db57f508-11a4-48cf-9fd3-be5088771039 req-63137bb3-b7f8-4c2d-8033-db4a12756aa7 service neutron] 10.222.0.74 "GET /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3888409 May 25 15:41:53.423658 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9caa8cb1-9e3e-4470-b0cc-89b7c704d726 req-8979213f-9df4-470d-ae2e-1cef61947e73 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6026974 May 25 15:41:53.440137 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c0251bdcdf59462a9c445346e1a63064&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1456742 May 25 15:41:53.445522 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fcf24db4-ef2a-47a6-9d48-aa429c892e71,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:53.452678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54604) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:53.461014 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.496275 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-8c5e8b42-f103-41c0-b460-09ea315c1ebb tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4699268 May 25 15:41:53.509833 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.609386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:53.617154 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.619948 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Usage tracker for resource:port and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:53.625614 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Quota usage for port was recalculated. Used quota:1. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:53.646240 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:53.646610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.676267 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.691070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Made reservation on behalf of 53352f5306c64e2191fc3770c3f34cb6 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:53.696917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.719244 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-74b2f4e6-c9aa-496e-b09b-650dd727af16 service neutron] 10.222.0.25 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3512483 May 25 15:41:53.755482 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-0c07ac2a-5f60-4a8f-b9d9-a401bb871b4f service neutron] 10.222.0.25 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2472365 May 25 15:41:53.890374 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.916073 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3f3ad405-55de-4edf-a0e6-653c06d040ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.931386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcf24db4-ef2a-47a6-9d48-aa429c892e71,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:53.945711 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.053643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Allocated IP 172.20.0.9 (e2c8de13-6b38-480d-a253-7798199b43d7/0eddaf48-c485-4fd6-aa56-c8209ff2711a/6b61c077-8a57-453b-88d9-aaea2e17596f) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:54.136717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.138539 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fcf24db4-ef2a-47a6-9d48-aa429c892e71 HTTP/1.1" status: 204 len: 168 time: 0.6846926 May 25 15:41:54.165402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.179086 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-325ba634-8b76-444d-b3ad-c0618156e5e8 req-8926c760-0f87-438e-aa4d-4e3446bb0c7a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 210 time: 0.0631289 May 25 15:41:54.183536 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.195688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=875955fc-0649-4ca5-a4ab-06401f1ffc7e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:54.219827 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-a7706755-9eb5-4416-b6d5-ac5bd70f5c0d service neutron] 10.222.0.25 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4469962 May 25 15:41:54.221001 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.242035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.243347 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/875955fc-0649-4ca5-a4ab-06401f1ffc7e HTTP/1.1" status: 204 len: 168 time: 0.9967885 May 25 15:41:54.542354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.615133 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.623262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.708681 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Network e2c8de13-6b38-480d-a253-7798199b43d7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:54.712552 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:54.716879 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:54.754608 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c29020-bf0e-4df9-947b-5d12dc7ba191 req-26ede726-62ca-4d4e-8348-fe1462a61550 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:54.756185 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00c29020-bf0e-4df9-947b-5d12dc7ba191 req-26ede726-62ca-4d4e-8348-fe1462a61550 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 944 time: 0.3001719 May 25 15:41:54.800023 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Pushing event updated for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:54.808732 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.841340 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00c29020-bf0e-4df9-947b-5d12dc7ba191 req-66302c05-66f3-46b8-870e-f017405b0a86 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794952 May 25 15:41:54.845120 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:54.845382 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.865544 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c49099-b98d-44c0-9d40-16d4454cbd6b req-8daed42a-305d-4ede-8bdc-031ef1d95d31 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:54.868327 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-89c49099-b98d-44c0-9d40-16d4454cbd6b req-8daed42a-305d-4ede-8bdc-031ef1d95d31 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 944 time: 0.2955549 May 25 15:41:54.876784 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6159046 May 25 15:41:54.904419 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Request body: {'port': {'device_id': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:54.949584 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-89c49099-b98d-44c0-9d40-16d4454cbd6b req-c73fab2d-405d-43c3-b5fc-32ae60b90aa8 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622265 May 25 15:41:55.040992 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:41:55.084488 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e682bc2-6920-4cf8-9dd0-51e071323872 req-cb2577aa-9042-4427-b146-208267804006 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 210 time: 0.0834682 May 25 15:41:55.084972 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54658) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:55.291314 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a3874420-2d78-4649-b7a8-ff28f400be15 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=203eb789c3e9438eab0ccb525ad70c17&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2051969 May 25 15:41:55.291985 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54672) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:55.308600 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-27d6c9c2-4616-4d9e-a71a-9cbfc8f45e0e req-2dcc411b-1e16-42a4-8f44-cd73a2fd760c tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 210 time: 0.1477356 May 25 15:41:55.427256 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:55.448951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.457860 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'port_id': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'mac_address': 'fa:16:3e:48:ae:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 836, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf87cdb0-06e4-4ee0-ad97-e62e40212515', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:41:55.466349 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.535361 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.555684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:55.564598 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.575066 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:55.581764 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.582969 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 47cc10ba-9942-4817-9ec9-0b0bdaf65164 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:41:55.585757 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.672300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-843c2e4c-f02e-4add-aa89-9a56632f3560 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.673844 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-843c2e4c-f02e-4add-aa89-9a56632f3560 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 818 time: 0.3643074 May 25 15:41:55.693482 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-909eaaeb-9f7c-4249-bfb3-017d08d6c4b9 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/quotas/53352f5306c64e2191fc3770c3f34cb6 HTTP/1.1" status: 200 len: 375 time: 0.0100818 May 25 15:41:55.756388 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.779722 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-45a652f9-cfc3-47b1-938e-bae18590adf7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.798217 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62b21947-ed7d-446e-85ee-48a912303760,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:55.848406 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164,segment=NetworkSegment(12684b13-b98f-4241-9d70-842214716852),segment_id=12684b13-b98f-4241-9d70-842214716852)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:55.857677 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.877389 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-43ddef65-3174-4507-a22d-a903b17e2897 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1665621 May 25 15:41:55.879908 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '47cc10ba-9942-4817-9ec9-0b0bdaf65164', 'network_id': '93554588-43bc-41aa-b595-47bd440305fb', 'port_id': '47cc10ba-9942-4817-9ec9-0b0bdaf65164', 'mac_address': 'fa:16:3e:7d:95:1b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 802, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '109089f6-966f-46c3-ac4d-c0610e95a24b', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:41:55.896085 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.897623 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:55.900107 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/62b21947-ed7d-446e-85ee-48a912303760 HTTP/1.1" status: 204 len: 168 time: 0.6027813 May 25 15:41:55.901883 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.989530 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.009944 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 47cc10ba-9942-4817-9ec9-0b0bdaf65164 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:56.034490 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164,segment=NetworkSegment(12684b13-b98f-4241-9d70-842214716852),segment_id=12684b13-b98f-4241-9d70-842214716852)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:56.045619 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.049713 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1f4a938c-42b4-4662-adda-7711e0f825a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.057685 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6b61c077-8a57-453b-88d9-aaea2e17596f {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:56.066977 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.083087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Transition to ACTIVE for port object 6b61c077-8a57-453b-88d9-aaea2e17596f will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:56.133169 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.184751 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:56.188506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.273640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-b7d6d4da-a122-49a6-92e5-22dfb44859fd service neutron] 10.222.0.25 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3948269 May 25 15:41:56.277224 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20f5495f-201e-4a86-b2c9-9a741d367a37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.290925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d00676e-8eb7-4385-a589-a9e0354c0bd4 req-76b5f39c-e4eb-4026-a73c-f87666b23e0f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.292698 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d00676e-8eb7-4385-a589-a9e0354c0bd4 req-76b5f39c-e4eb-4026-a73c-f87666b23e0f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 945 time: 0.1648753 May 25 15:41:56.438006 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d00676e-8eb7-4385-a589-a9e0354c0bd4 req-ebca7565-61de-41b4-88bb-a28fb8ba6642 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229539 May 25 15:41:56.472938 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Pushing event updated for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:56.515432 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.529094 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-e9248132-7b88-4d28-87a0-25f841b5f24d service neutron] 10.222.0.25 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2320035 May 25 15:41:56.566936 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-e82c5598-eaeb-4ac5-a0f4-bae8954315b2 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.568723 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-e82c5598-eaeb-4ac5-a0f4-bae8954315b2 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 810 time: 0.4831383 May 25 15:41:56.600359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Attempting to bind port 6b61c077-8a57-453b-88d9-aaea2e17596f on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:56.600485 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Attempting to bind port 6b61c077-8a57-453b-88d9-aaea2e17596f by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:56.600724 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Attempting to bind port 6b61c077-8a57-453b-88d9-aaea2e17596f on network e2c8de13-6b38-480d-a253-7798199b43d7 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:56.606070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Port 6b61c077-8a57-453b-88d9-aaea2e17596f on network e2c8de13-6b38-480d-a253-7798199b43d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:41:56.606901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Attempting to bind port 6b61c077-8a57-453b-88d9-aaea2e17596f on network e2c8de13-6b38-480d-a253-7798199b43d7 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:56.614229 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:56.614570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Checking segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:56.614955 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Bound using segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:56.615393 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Bound port: 6b61c077-8a57-453b-88d9-aaea2e17596f, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:56.615943 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.742715 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['47cc10ba-9942-4817-9ec9-0b0bdaf65164'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:41:56.777315 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-65f95bbd-7de5-45f8-997b-f36b72b0fdd8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 379 time: 0.1504295 May 25 15:41:56.802443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:41:56.869117 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'port': {'device_id': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'admin_state_up': True, 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'security_groups': ['ded7460c-4a06-481d-9879-887b2520ce54']}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:56.949056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:56.994486 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15741bf7-adcd-46b1-a83a-a89522ef6acc req-4187f5b5-e2a7-4112-9da7-c78ce83aa843 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.999192 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-15741bf7-adcd-46b1-a83a-a89522ef6acc req-4187f5b5-e2a7-4112-9da7-c78ce83aa843 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 945 time: 0.2562423 May 25 15:41:57.079313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=6b61c077-8a57-453b-88d9-aaea2e17596f,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:57.089850 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:57.123190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.182123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1da0082b-5c8c-451f-8448-9b1ce2a8f343 req-dd4b0a27-9a98-43ff-8e00-f37c6c5e622d tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 210 time: 0.0825355 May 25 15:41:57.199274 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-15741bf7-adcd-46b1-a83a-a89522ef6acc req-125d8c6b-a324-48a7-9da5-6a3926f6c2a6 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1872385 May 25 15:41:57.300407 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.301030 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:57.302400 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] 10.222.0.74 "PUT /v2.0/ports/6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 1093 time: 2.4065681 May 25 15:41:57.302893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:57.354603 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:57.399688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:57.410341 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Pushing event updated for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:57.441404 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.570775 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Made reservation on behalf of 0b066f0c91e94675a5051ab935c145f5 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:57.576973 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:57.595067 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e2c75fea-7ab8-4bad-ac6e-5cb3ef7e86b5 req-229548d3-61ed-4b32-83da-423969029d33 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 210 time: 0.2300580 May 25 15:41:57.635240 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-39b9419e-ea60-420c-bd99-30b6395e4063 req-910e352a-6b34-443c-81aa-f143bce1ce76 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 210 time: 0.2691784 May 25 15:41:57.751408 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f', 'status': 'completed', 'code': 200} May 25 15:41:57.773728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-2baf2567-91cd-46db-8610-dea4f16c88bb tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.779424 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-2baf2567-91cd-46db-8610-dea4f16c88bb tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 817 time: 0.5961604 May 25 15:41:57.841077 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-07ff6194-919a-4a30-8482-597989f21a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.842554 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-07ff6194-919a-4a30-8482-597989f21a43 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1096 time: 0.3984208 May 25 15:41:57.941838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54782) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:57.970527 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-8c00aa65-eece-46f2-a378-a199ba518318 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.1045096 May 25 15:41:57.971728 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Allocated IP 172.20.0.6 (132a5a94-c14e-4969-994e-837fe8b01394/cc89f65d-3227-4230-ac5b-a3041bcec0e2/fc98b49d-704b-4dfb-bedd-e8a999ed769b) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:58.039213 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-c837de3f-dba8-4043-a964-fcf6e60f5566 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 380 time: 0.2285409 May 25 15:41:58.066919 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'port': {'device_id': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'admin_state_up': True, 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'security_groups': ['5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:58.241598 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc59542f-a24b-4cb4-9dac-2c9d89a78121 req-693f6e79-1135-4a6c-946d-515784f17a9d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.251831 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dc59542f-a24b-4cb4-9dac-2c9d89a78121 req-693f6e79-1135-4a6c-946d-515784f17a9d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 945 time: 0.4093196 May 25 15:41:58.258026 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:58.290368 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:58.304353 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ac86b9-c034-417c-b52e-2770c18770bf req-7541e1c6-8552-472b-be46-a6b4160e8a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.305803 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-7541e1c6-8552-472b-be46-a6b4160e8a76 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.2850416 May 25 15:41:58.312697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Usage tracker for resource:security_group_rule and tenant:2b1396991f5d4bc7b90b960742337af9 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:58.318329 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:58.345508 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dc59542f-a24b-4cb4-9dac-2c9d89a78121 req-585b4191-9a40-4359-931d-8719fb779680 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926960 May 25 15:41:58.364872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:58.391541 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-c81f9ce7-cfe6-4515-af43-4734171a56ec service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0700474 May 25 15:41:58.449395 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:58.455339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:port and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:58.459622 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:58.468412 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:58.494765 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1cf237-d161-41b0-a9e0-1aaf69f5c584 req-69e85e35-84c9-43fc-9139-3ddf8ea3e2bc tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.496398 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c1cf237-d161-41b0-a9e0-1aaf69f5c584 req-69e85e35-84c9-43fc-9139-3ddf8ea3e2bc tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 945 time: 0.1456752 May 25 15:41:58.497670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Made reservation on behalf of dd09b4c567df401194ac3825fe2e3080 for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:58.501132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:58.558051 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:58.627223 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Transition to ACTIVE for port object fc98b49d-704b-4dfb-bedd-e8a999ed769b will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:58.765116 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-1007f1c0-2dcd-46dc-b8da-3e12ad8fab4c service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3539557 May 25 15:41:58.773186 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.74', 61738) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:58.794290 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c1cf237-d161-41b0-a9e0-1aaf69f5c584 req-fda2b270-5569-4cf1-b36d-978331e6c4d8 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2815907 May 25 15:41:58.796401 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-becfb651-404e-438a-91c5-eac282fd4b5f req-eeedd98f-0d96-4df7-8cde-e79b8ce28bfe tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 210 time: 0.2576613 May 25 15:41:58.801035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Allocated IP 172.20.0.14 (f2d88153-7a7c-4433-8f94-c27a6e5feb07/139c7c04-45f8-44c4-90ec-3068f09f624c/4db5be42-79ac-4400-b3f9-ff41ef933d17) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:58.991696 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.003019 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:59.161231 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f849b851-24ad-424e-ba60-8209a74bf0b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.177486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-bbb64a7f-58e7-45be-ae07-0aa6173b093f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.179143 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-bbb64a7f-58e7-45be-ae07-0aa6173b093f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 818 time: 0.4045706 May 25 15:41:59.186431 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:59.194503 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:59.195098 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.260817 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13efa38f-aac3-4871-aacb-64780d1649b2 req-05251db9-93a7-4e68-83f0-d51d656c11e7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 210 time: 0.1502781 May 25 15:41:59.270181 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.273704 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-79ac86b9-c034-417c-b52e-2770c18770bf req-329f964b-abe2-4137-a60f-36f128553d3c service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4917183 May 25 15:41:59.276838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.278598 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.289556 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Transition to ACTIVE for port object 4db5be42-79ac-4400-b3f9-ff41ef933d17 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:59.293404 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Request body: {'port': {'device_id': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'admin_state_up': True, 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:59.323426 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcaf54f3-2ce4-483e-95e6-3176cf789a73 req-be9bb43b-4fd5-4bfb-9141-fd56edad8f20 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.331796 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fcaf54f3-2ce4-483e-95e6-3176cf789a73 req-be9bb43b-4fd5-4bfb-9141-fd56edad8f20 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 931 time: 0.2227569 May 25 15:41:59.378931 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.405752 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2b1396991f5d4bc7b90b960742337af9&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4544539 May 25 15:41:59.409736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54838) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:59.421323 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fcaf54f3-2ce4-483e-95e6-3176cf789a73 req-e2d0661d-1218-4bef-ad4c-9dbd94ae70ba tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878549 May 25 15:41:59.432973 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.441258 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.541884 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Network 132a5a94-c14e-4969-994e-837fe8b01394 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:59.552551 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:59.556038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:59.556278 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.561252 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:59.620443 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:59.621053 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:59.630133 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:59.707938 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:59.723060 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.736114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.772760 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.773421 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.826983 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17074cff-60fd-44a9-9c70-543f217a9430 req-eb073908-9783-43d3-b926-ac2a083a6623 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.828720 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-17074cff-60fd-44a9-9c70-543f217a9430 req-eb073908-9783-43d3-b926-ac2a083a6623 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 945 time: 0.2268629 May 25 15:41:59.831618 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7684860 May 25 15:41:59.835890 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.838489 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:59.853326 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.854382 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 47cc10ba-9942-4817-9ec9-0b0bdaf65164 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:59.872896 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Request body: {'port': {'device_id': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:59.980206 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.998191 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54858) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:00.042977 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96e3a34b-ca07-49fe-9caf-2f047d08c727,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.067078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-d820f367-5b48-410b-96ba-ec466be88dad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.068761 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-d820f367-5b48-410b-96ba-ec466be88dad service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1096 time: 0.5888991 May 25 15:42:00.069365 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.078659 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f0317466-639f-4af4-82c0-be7b66c31e4d None None] Provisioning for port 4db5be42-79ac-4400-b3f9-ff41ef933d17 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:00.087668 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f0317466-639f-4af4-82c0-be7b66c31e4d None None] Provisioning complete for port 4db5be42-79ac-4400-b3f9-ff41ef933d17 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:00.088064 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f0317466-639f-4af4-82c0-be7b66c31e4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.091992 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.709s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.092603 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.688s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.125719 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.129063 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.130174 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:00.144857 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-17074cff-60fd-44a9-9c70-543f217a9430 req-9f6948d9-81fe-48bc-a792-6c7066c65654 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2969427 May 25 15:42:00.149847 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:00.150155 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.192471 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.272891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.278002 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-f0317466-639f-4af4-82c0-be7b66c31e4d None None] Port 4db5be42-79ac-4400-b3f9-ff41ef933d17 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:00.288602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.295240 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6398c858-a68b-4565-98a9-b0f0284b6da1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.103s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.337256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.337870 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.349998 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96e3a34b-ca07-49fe-9caf-2f047d08c727,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.352590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.368630 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.384576 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.397230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164,segment=NetworkSegment(12684b13-b98f-4241-9d70-842214716852),segment_id=12684b13-b98f-4241-9d70-842214716852)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:00.397467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f376b295-ce53-45a6-94bb-d3e6dc94560e req-12a586a7-c564-40a4-b90f-61c2d2058a79 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.399089 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f376b295-ce53-45a6-94bb-d3e6dc94560e req-12a586a7-c564-40a4-b90f-61c2d2058a79 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 945 time: 0.3060918 May 25 15:42:00.415209 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.418277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.425514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:00.431696 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:00.436712 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Usage tracker for resource:port and tenant:53352f5306c64e2191fc3770c3f34cb6 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:00.440286 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.5935087 May 25 15:42:00.441001 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.442008 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/96e3a34b-ca07-49fe-9caf-2f047d08c727 HTTP/1.1" status: 204 len: 168 time: 0.9754491 May 25 15:42:00.452451 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:00.456190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Usage tracker for resource:security_group_rule and tenant:7a281ed47bdd4d06803352fd5b41fbc1 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:00.466877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:00.469209 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:00.476201 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Request body: {'port': {'device_id': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:00.487585 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-38534d12-60b6-4baa-8f2d-17ad7d7fc7ce None None] Provisioning for port fc98b49d-704b-4dfb-bedd-e8a999ed769b completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:00.498429 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-38534d12-60b6-4baa-8f2d-17ad7d7fc7ce None None] Provisioning complete for port fc98b49d-704b-4dfb-bedd-e8a999ed769b triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:00.498816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-38534d12-60b6-4baa-8f2d-17ad7d7fc7ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.509022 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:00.522700 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f376b295-ce53-45a6-94bb-d3e6dc94560e req-e05bab7a-edd3-4d79-986d-334061fa25fd tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143000 May 25 15:42:00.530214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-ce04c1f2-1733-4682-b454-eedd401bd072 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.531746 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-ce04c1f2-1733-4682-b454-eedd401bd072 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.3461766 May 25 15:42:00.564121 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ae350b-1cae-461d-ad82-546e8cefc23f req-3996cd7a-b474-4cd1-9c1f-4f869b508130 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.564932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-32ae350b-1cae-461d-ad82-546e8cefc23f req-3996cd7a-b474-4cd1-9c1f-4f869b508130 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Synchronizing usage tracker for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:00.630511 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.643069 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.657016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-38534d12-60b6-4baa-8f2d-17ad7d7fc7ce None None] Port fc98b49d-704b-4dfb-bedd-e8a999ed769b cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:00.691202 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Made reservation on behalf of 53352f5306c64e2191fc3770c3f34cb6 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:00.695039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.765800 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-72a3a129-2560-42e5-8a77-5e209f2de842 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.2240233 May 25 15:42:00.786856 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'code': 200} May 25 15:42:00.926644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54878) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:00.930111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.962681 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4638715e-e06d-4716-9233-2ac957684ce2 req-f47ebe24-c405-4bf4-8734-cc775ef4fd4e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 210 time: 0.0653639 May 25 15:42:00.982456 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4db5be42-79ac-4400-b3f9-ff41ef933d17 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:00.990447 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.009018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Transition to ACTIVE for port object 4db5be42-79ac-4400-b3f9-ff41ef933d17 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:01.014301 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.020194 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.021951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.031963 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-69498a33-8a23-44c3-a046-7bf60f5e22ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.033618 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-69498a33-8a23-44c3-a046-7bf60f5e22ab service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.2464285 May 25 15:42:01.089209 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.74', 61742) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:01.182116 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.253125 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:01.269986 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.271191 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Usage tracker for resource:security_group_rule and tenant:a3b205ec2dde43d8b32982e328a94008 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:01.285118 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-2b42e218-36fe-437e-a8f9-4811fec6dba5 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1909080 May 25 15:42:01.292872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:01.311249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Pushing event updated for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:01.317655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-32ae350b-1cae-461d-ad82-546e8cefc23f req-3996cd7a-b474-4cd1-9c1f-4f869b508130 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Unset dirty status for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:01.320380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:01.323493 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.324037 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-32ae350b-1cae-461d-ad82-546e8cefc23f req-3996cd7a-b474-4cd1-9c1f-4f869b508130 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 932 time: 1.0403361 May 25 15:42:01.352506 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.332s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.420080 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-32ae350b-1cae-461d-ad82-546e8cefc23f req-1c0f7294-2c27-4f3e-9827-090123e227a9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0951514 May 25 15:42:01.461128 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Allocated IP 172.20.0.3 (e2c8de13-6b38-480d-a253-7798199b43d7/0eddaf48-c485-4fd6-aa56-c8209ff2711a/470d8e34-1962-4b04-9960-85526f36bc84) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:01.469972 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142fe4a7-2408-4f3a-addd-d650a1ec1c6e req-8c35c384-861e-4ed8-acaf-c1c5a2f32c51 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.477772 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-142fe4a7-2408-4f3a-addd-d650a1ec1c6e req-8c35c384-861e-4ed8-acaf-c1c5a2f32c51 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 931 time: 0.3894660 May 25 15:42:01.516304 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.534876 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7a281ed47bdd4d06803352fd5b41fbc1&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5240202 May 25 15:42:01.545936 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54894) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:01.590290 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3825111-c5b6-47c6-aec9-ece9b03cbd98,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:01.602575 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-b1fb8e1d-a6c7-481c-ad65-84fada58a48b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.604076 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-b1fb8e1d-a6c7-481c-ad65-84fada58a48b service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.4633005 May 25 15:42:01.604321 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.625993 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Attempting to bind port 4db5be42-79ac-4400-b3f9-ff41ef933d17 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:01.626335 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Attempting to bind port 4db5be42-79ac-4400-b3f9-ff41ef933d17 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:01.626691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Attempting to bind port 4db5be42-79ac-4400-b3f9-ff41ef933d17 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:01.654343 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.678378 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-142fe4a7-2408-4f3a-addd-d650a1ec1c6e req-c631737b-df3f-4393-b23f-56371b8d3552 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1848881 May 25 15:42:01.716411 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Port 4db5be42-79ac-4400-b3f9-ff41ef933d17 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:01.716974 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Attempting to bind port 4db5be42-79ac-4400-b3f9-ff41ef933d17 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:01.718302 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f6b18b8d-f519-47ed-a3f6-df8af2e8097c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.730520 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:01.734928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Usage tracker for resource:security_group_rule and tenant:c1e4dad1b2de4697bcce69b7b2bf68f6 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:01.738116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:01.745149 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:01.835785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:01.835988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Checking segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:01.836319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Bound using segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:01.836848 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Bound port: 4db5be42-79ac-4400-b3f9-ff41ef933d17, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:01.836965 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-ba438166-159c-4f63-a531-b515e53cbf38 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5211089 May 25 15:42:01.837388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.957533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.971077 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:01.989080 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.002647 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.011812 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.022150 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.052190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f0348a2a-1657-4e31-8840-f0ac17caaef5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.072732 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4492135 May 25 15:42:02.125819 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.145847 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39bf8e0a-b388-4488-a5ec-a050bb33b898 req-1550756b-f2eb-4751-b9dd-9c5dd8cb9f2f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.147332 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-39bf8e0a-b388-4488-a5ec-a050bb33b898 req-1550756b-f2eb-4751-b9dd-9c5dd8cb9f2f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 946 time: 0.6152623 May 25 15:42:02.148015 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=697ab436-410f-48b2-a042-84a1238ea553,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.152262 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.154741 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:02.163595 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a3b205ec2dde43d8b32982e328a94008&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2239397 May 25 15:42:02.179662 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54910) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:02.182410 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fc98b49d-704b-4dfb-bedd-e8a999ed769b {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:02.189721 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.196479 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=592a5118-e7ef-47cc-9f8d-7a128ce9b1f0,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.199190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:02.200014 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.205974 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.209464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fd2078-c3fe-4c2c-9ca1-ad4862a809c9 req-de232c67-3db0-444e-b94b-65b3f53ad0ed tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.209651 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f4a41aa6-bf3d-407b-9038-bec1891da17b req-b6de2688-fc4a-4970-964a-1809305161da service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3623955 May 25 15:42:02.216609 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-42fd2078-c3fe-4c2c-9ca1-ad4862a809c9 req-de232c67-3db0-444e-b94b-65b3f53ad0ed tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.3951471 May 25 15:42:02.224124 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Transition to ACTIVE for port object fc98b49d-704b-4dfb-bedd-e8a999ed769b will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:02.231176 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.237660 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.249183 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.296783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1298b702-1ae8-45b7-a36c-407237c5ce6b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.378108 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Pushing event updated for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.387966 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-39bf8e0a-b388-4488-a5ec-a050bb33b898 req-8a8a078e-40d5-4ad8-b1bd-91586a51e9b3 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2285686 May 25 15:42:02.401420 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.402047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.403490 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] 10.222.0.74 "PUT /v2.0/ports/4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 1094 time: 2.5352561 May 25 15:42:02.411250 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:02.411453 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.411453 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.421003 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-42fd2078-c3fe-4c2c-9ca1-ad4862a809c9 req-e64fb6fa-3feb-4be4-9508-fe0e4c782211 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2035270 May 25 15:42:02.436312 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Pushing event updated for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.454881 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.459518 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.481167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.490253 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.525842 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7d01e8a6-627c-4be6-851f-054f4bd751aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.544299 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.551632 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3825111-c5b6-47c6-aec9-ece9b03cbd98,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.558570 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.575717 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'status': 'completed', 'code': 200} May 25 15:42:02.579151 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.580638 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d3825111-c5b6-47c6-aec9-ece9b03cbd98 HTTP/1.1" status: 204 len: 168 time: 1.0220637 May 25 15:42:02.659741 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.670327 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5ca33153-88a3-440e-ab89-79227682648d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.704786 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.709858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=592a5118-e7ef-47cc-9f8d-7a128ce9b1f0,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.784653 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.788052 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:02.813353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.814668 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/592a5118-e7ef-47cc-9f8d-7a128ce9b1f0 HTTP/1.1" status: 204 len: 168 time: 0.6300631 May 25 15:42:02.858462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Network e2c8de13-6b38-480d-a253-7798199b43d7 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:02.865056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:02.891158 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:02.906493 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97893eda-c358-4fb6-af7a-8373b4ffc956 req-97a59ecd-97ac-4a2b-820b-02ca9a718ee2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.907977 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-97893eda-c358-4fb6-af7a-8373b4ffc956 req-97a59ecd-97ac-4a2b-820b-02ca9a718ee2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 931 time: 0.2048485 May 25 15:42:02.921700 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7f2f0c-58cd-4447-b03e-a6d48dc53283 req-3176ef17-1e18-4249-8e5c-47410b0c8b23 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.923181 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2d7f2f0c-58cd-4447-b03e-a6d48dc53283 req-3176ef17-1e18-4249-8e5c-47410b0c8b23 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 944 time: 0.1169941 May 25 15:42:02.931626 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Attempting to bind port fc98b49d-704b-4dfb-bedd-e8a999ed769b on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:02.931959 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Attempting to bind port fc98b49d-704b-4dfb-bedd-e8a999ed769b by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:02.932287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Attempting to bind port fc98b49d-704b-4dfb-bedd-e8a999ed769b on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:02.952524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Port fc98b49d-704b-4dfb-bedd-e8a999ed769b on network 132a5a94-c14e-4969-994e-837fe8b01394 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:02.952849 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Attempting to bind port fc98b49d-704b-4dfb-bedd-e8a999ed769b on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:02.963612 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Pushing event updated for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:02.973457 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.492s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.976820 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:02.977213 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Checking segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:02.977634 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Bound using segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:02.978135 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Bound port: fc98b49d-704b-4dfb-bedd-e8a999ed769b, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:02.978524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.005265 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2d7f2f0c-58cd-4447-b03e-a6d48dc53283 req-1e5444ec-048b-4789-ba09-361dd0e4a19c tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645580 May 25 15:42:03.008092 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-97893eda-c358-4fb6-af7a-8373b4ffc956 req-d33e636e-1b85-46a8-a4cf-3060f8dc447d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Synchronizing usage tracker for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:03.011756 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 6b61c077-8a57-453b-88d9-aaea2e17596f details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:03.012615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.013254 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.031328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-97893eda-c358-4fb6-af7a-8373b4ffc956 req-d33e636e-1b85-46a8-a4cf-3060f8dc447d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Unset dirty status for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:03.032782 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-97893eda-c358-4fb6-af7a-8373b4ffc956 req-d33e636e-1b85-46a8-a4cf-3060f8dc447d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086912 May 25 15:42:03.072150 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-1cc6f9e4-c013-4a79-8d1b-7b4bc8d0a465 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.073866 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-1cc6f9e4-c013-4a79-8d1b-7b4bc8d0a465 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1097 time: 0.3360052 May 25 15:42:03.174837 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=6b61c077-8a57-453b-88d9-aaea2e17596f,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:03.179399 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.9044652 May 25 15:42:03.182390 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-9aabe78b-cd7d-4df9-b654-b076e427381d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 217 time: 0.0759611 May 25 15:42:03.185212 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:03.190468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '6b61c077-8a57-453b-88d9-aaea2e17596f', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'port_id': '6b61c077-8a57-453b-88d9-aaea2e17596f', 'mac_address': 'fa:16:3e:11:ec:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 845, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:03.192717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:03.193244 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164', 'code': 200} May 25 15:42:03.203091 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.208069 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.269853 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.288223 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6b61c077-8a57-453b-88d9-aaea2e17596f {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:03.321583 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=6b61c077-8a57-453b-88d9-aaea2e17596f,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:03.333604 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.335902 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.363807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Request body: {'port': {'device_id': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:03.448686 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54940) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:03.453779 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:03.457203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.472510 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e7dc0f-e965-4256-a89a-390a826c144f req-55c80194-5ac3-427e-9ff5-76f3bb04d476 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.480114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.480769 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.482324 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] 10.222.0.74 "PUT /v2.0/ports/fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 1093 time: 3.0200553 May 25 15:42:03.482905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:03.487150 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c3e7dc0f-e965-4256-a89a-390a826c144f req-55c80194-5ac3-427e-9ff5-76f3bb04d476 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 943 time: 0.2323842 May 25 15:42:03.554988 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.618770 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-c69ec5ac-0f92-41cb-9716-89bf6b655f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.620392 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-c69ec5ac-0f92-41cb-9716-89bf6b655f28 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.3314064 May 25 15:42:03.674152 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:03.705096 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Pushing event updated for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:03.709512 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Usage tracker for resource:security_group_rule and tenant:eb37649cf8eb459f85491f4270f3e70f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:03.750380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:03.753076 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.545s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.769450 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:03.788145 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['6b61c077-8a57-453b-88d9-aaea2e17596f'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:03.839893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.851717 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c3e7dc0f-e965-4256-a89a-390a826c144f req-ae0effd3-06c6-4f23-bad8-c430fce4fdf0 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3635976 May 25 15:42:03.903926 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41e7942-cc5f-489a-bf6b-6a9b599a0602 req-e8638866-0258-488e-b1b1-aac2d75bc054 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.910722 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-d41e7942-cc5f-489a-bf6b-6a9b599a0602 req-e8638866-0258-488e-b1b1-aac2d75bc054 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 1099 time: 0.3283958 May 25 15:42:03.938475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-9fe094b9-1678-43be-8866-4d470ee22161 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.939991 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-9fe094b9-1678-43be-8866-4d470ee22161 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1096 time: 0.3582807 May 25 15:42:03.970586 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb11fe2-6b46-46d0-9f86-62afdc714ea1 req-0ef2dc3d-ec2e-4e45-b83b-c7408d42b567 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.983922 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2eb11fe2-6b46-46d0-9f86-62afdc714ea1 req-0ef2dc3d-ec2e-4e45-b83b-c7408d42b567 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 946 time: 0.3572333 May 25 15:42:04.048632 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-f1e0e9ff-95f1-4bd8-aa81-8bc1f490a965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.051363 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-f1e0e9ff-95f1-4bd8-aa81-8bc1f490a965 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3495476 May 25 15:42:04.203280 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-d41e7942-cc5f-489a-bf6b-6a9b599a0602 req-36889254-a016-4869-aa3a-66584c07457b service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2594209 May 25 15:42:04.222874 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-e4f754e5-a5e5-47e3-ad0d-99e4d15c87c9 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 217 time: 0.2367446 May 25 15:42:04.260965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54970) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:04.284345 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2eb11fe2-6b46-46d0-9f86-62afdc714ea1 req-713800e3-79b8-4b6f-abc8-6acffc6da109 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2972214 May 25 15:42:04.331613 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2affc588-dded-4046-8871-daf2267a4be4 req-eeeb8593-ce61-4684-beda-e331ebf2344f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.338048 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2affc588-dded-4046-8871-daf2267a4be4 req-eeeb8593-ce61-4684-beda-e331ebf2344f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.2039261 May 25 15:42:04.349540 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'status': 'completed', 'code': 200} May 25 15:42:04.384793 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.403767 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.421255 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.425078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.433168 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2affc588-dded-4046-8871-daf2267a4be4 req-063f26c5-7223-479d-8d14-9e99c2012bfe tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670979 May 25 15:42:04.444454 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-baae5fb3-c228-4e2f-b951-6da912bfd616 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.453742 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=eb37649cf8eb459f85491f4270f3e70f&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0012963 May 25 15:42:04.463656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54980) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:04.467603 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-08344361-22e8-4c38-b68c-cb7cc59129e7 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3619857 May 25 15:42:04.489430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.504837 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:04.509418 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Usage tracker for resource:security_group_rule and tenant:77c1050773754cce91de4dd929bc28cc is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:04.511939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:04.518758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:04.520583 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b714d927-416b-417b-a069-462d5cd6c695,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:04.530243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.582849 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.659465 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.674917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 470d8e34-1962-4b04-9960-85526f36bc84 {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:04.689916 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.796565 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Transition to ACTIVE for port object 470d8e34-1962-4b04-9960-85526f36bc84 will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:04.821720 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.827642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-58ee90b6-9756-4f05-9665-3f6970543a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.829727 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-58ee90b6-9756-4f05-9665-3f6970543a9e service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.1404922 May 25 15:42:04.843662 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.889650 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b696890-d6ec-4461-8b2d-aadf1c787950 req-ee3a85cf-2e3e-4271-a6bc-8edd34e5e306 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.897577 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b696890-d6ec-4461-8b2d-aadf1c787950 req-ee3a85cf-2e3e-4271-a6bc-8edd34e5e306 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 944 time: 0.3335323 May 25 15:42:04.900876 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.908643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.912103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4d229a37-3a9b-40dc-8895-798f997d543f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.984784 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126094d8-95f1-4c83-9baf-c82439a0a399 req-930834e7-8fec-422f-aa23-22b982423172 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.991715 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-126094d8-95f1-4c83-9baf-c82439a0a399 req-930834e7-8fec-422f-aa23-22b982423172 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 931 time: 0.3485425 May 25 15:42:05.024179 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2bf5626-73af-4d38-8e57-63d68e5b6ca6,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:05.038880 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.045376 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=77c1050773754cce91de4dd929bc28cc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7815115 May 25 15:42:05.046540 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54996) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:05.070022 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.076930 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b696890-d6ec-4461-8b2d-aadf1c787950 req-a6358c6e-581b-4f4b-88fc-b688be026605 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1792150 May 25 15:42:05.111270 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Pushing event updated for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:05.116399 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-43aa0f9e-332d-4ce0-958b-da625b1d97b7 req-8c26a03c-4613-4f7a-953a-39ad288505d7 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4198067 May 25 15:42:05.117600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.120206 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f02dcb8e-9646-4aa3-9700-1621a1a90671 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.041s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.123849 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-126094d8-95f1-4c83-9baf-c82439a0a399 req-b6e09236-27fc-4e8d-9c26-99d9b03471e0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1312120 May 25 15:42:05.133975 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b714d927-416b-417b-a069-462d5cd6c695,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:05.136136 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.137568 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b714d927-416b-417b-a069-462d5cd6c695 HTTP/1.1" status: 204 len: 168 time: 0.6726856 May 25 15:42:05.138764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.174190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-6db9e860-8421-455d-b490-0d5f7eba56e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.175704 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-6db9e860-8421-455d-b490-0d5f7eba56e5 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3332963 May 25 15:42:05.176543 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.276678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Attempting to bind port 470d8e34-1962-4b04-9960-85526f36bc84 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:05.277634 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Attempting to bind port 470d8e34-1962-4b04-9960-85526f36bc84 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:05.279643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Attempting to bind port 470d8e34-1962-4b04-9960-85526f36bc84 on network e2c8de13-6b38-480d-a253-7798199b43d7 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:05.286486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Port 470d8e34-1962-4b04-9960-85526f36bc84 on network e2c8de13-6b38-480d-a253-7798199b43d7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:05.287062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Attempting to bind port 470d8e34-1962-4b04-9960-85526f36bc84 on network e2c8de13-6b38-480d-a253-7798199b43d7 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:05.302088 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:05.304863 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Checking segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:05.305287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Bound using segment: {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:05.305739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Bound port: 470d8e34-1962-4b04-9960-85526f36bc84, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dca04af7-3ba4-4736-9f48-ea4624485914', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 845, 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:05.306127 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.355307 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.425237 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:42:05.533928 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-a5d2eb16-f6b0-4862-9139-3dc02a7218fa service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3421130 May 25 15:42:05.546969 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e45ac9a-ce18-4cdc-8e4c-a6f84ebe242d req-a25d1794-278d-41a3-bb6d-1d97f4d63e57 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.546969 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e45ac9a-ce18-4cdc-8e4c-a6f84ebe242d req-a25d1794-278d-41a3-bb6d-1d97f4d63e57 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 943 time: 0.3103154 May 25 15:42:05.579126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.618188 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-1e3bf6a9-1b2a-4c0d-b25d-1995034c52a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.620401 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-1e3bf6a9-1b2a-4c0d-b25d-1995034c52a1 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1097 time: 0.2885487 May 25 15:42:05.622160 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:05.625769 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=470d8e34-1962-4b04-9960-85526f36bc84,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:05.672833 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.673797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.681018 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.706027 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2bf5626-73af-4d38-8e57-63d68e5b6ca6,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:05.718220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.757108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc1ab3e-600c-4ec2-b5a9-d84c4911845b req-facc31b7-1de8-43ed-b883-1978d056f7a0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.758623 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8fc1ab3e-600c-4ec2-b5a9-d84c4911845b req-facc31b7-1de8-43ed-b883-1978d056f7a0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 946 time: 0.3350437 May 25 15:42:05.764958 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e45ac9a-ce18-4cdc-8e4c-a6f84ebe242d req-a96753a0-9385-467d-8641-b34ed6a74ccc tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1946304 May 25 15:42:05.765738 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.769472 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f2bf5626-73af-4d38-8e57-63d68e5b6ca6 HTTP/1.1" status: 204 len: 168 time: 0.7144034 May 25 15:42:05.823759 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c02a320-964e-406a-a79c-ea3d3a9073f5 req-94b7d321-26f1-4be1-9545-0df502264284 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2744477 May 25 15:42:05.835975 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8fc1ab3e-600c-4ec2-b5a9-d84c4911845b req-ddc28389-5209-4b52-94bd-6a1e88f1a1d8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633335 May 25 15:42:05.860059 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.861677 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.863762 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] 10.222.0.74 "PUT /v2.0/ports/470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 1093 time: 2.5758781 May 25 15:42:05.954277 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-1aa2e25d-ff79-4f76-a8d3-bf0935fc1957 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.956710 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-1aa2e25d-ff79-4f76-a8d3-bf0935fc1957 service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.3199391 May 25 15:42:05.965397 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Pushing event updated for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:05.968633 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.119797 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-55be5800-0c2f-4fb3-9214-278b5b3ecd91 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 217 time: 0.0962706 May 25 15:42:06.120295 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55034) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:06.184474 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733e2bfe-61f0-404a-a6d3-ae6b78d8e0cb req-3a70ff30-f7d0-4cb2-ba6a-87f6ac81e322 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.204186 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-733e2bfe-61f0-404a-a6d3-ae6b78d8e0cb req-3a70ff30-f7d0-4cb2-ba6a-87f6ac81e322 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.2622428 May 25 15:42:06.261318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-462f9cee-5724-4930-91af-edd9c3815164 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.265049 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-462f9cee-5724-4930-91af-edd9c3815164 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.1129425 May 25 15:42:06.306966 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-733e2bfe-61f0-404a-a6d3-ae6b78d8e0cb req-c77d24a0-66eb-448f-83fd-f93007ceba45 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933464 May 25 15:42:06.396311 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:06.468738 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-6418475f-5faf-4f4e-8d08-b7bfadef828a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.470543 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-6418475f-5faf-4f4e-8d08-b7bfadef828a service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1683574 May 25 15:42:06.473394 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-0599316a-9aba-4bf0-9b2a-cb54a68eea84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.474969 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-0599316a-9aba-4bf0-9b2a-cb54a68eea84 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1096 time: 0.1287789 May 25 15:42:06.475325 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-f8025898-3b6f-4676-b34e-64be1b71ab54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.477524 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-f8025898-3b6f-4676-b34e-64be1b71ab54 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1096 time: 0.4425337 May 25 15:42:06.498591 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:06.516806 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:06.520625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Usage tracker for resource:security_group_rule and tenant:e4e45bdc681c409bb0e2e8f36180f8d0 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:06.523444 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:06.529747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:06.545962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55bc0a5-0d60-4091-97ea-494ec5c26c32 req-c8c619e0-aa92-473b-b7a7-88e796586563 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.548520 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f55bc0a5-0d60-4091-97ea-494ec5c26c32 req-c8c619e0-aa92-473b-b7a7-88e796586563 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 944 time: 0.2382472 May 25 15:42:06.615433 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55054) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:06.765403 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:06.785259 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-3c429d65-12f2-4c56-98df-d43c1de79494 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.2355096 May 25 15:42:06.811441 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:06.822735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:06.830720 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:06.838142 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Usage tracker for resource:security_group_rule and tenant:40ecb10ba55142a78102643c5cbd56d9 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:06.845830 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-73e2f179-56db-41e3-b6b2-c72503aeba66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.857214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:06.873044 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f55bc0a5-0d60-4091-97ea-494ec5c26c32 req-ecbc51aa-6418-4941-9807-b7ab6e370b52 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2458432 May 25 15:42:06.890168 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-81a93c80-51d3-42c7-9eaf-88d9f474fd3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.891529 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-81a93c80-51d3-42c7-9eaf-88d9f474fd3e service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0896311 May 25 15:42:06.912392 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:06.951989 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e4e45bdc681c409bb0e2e8f36180f8d0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8305628 May 25 15:42:06.952590 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3dd4f4-a59a-4b2a-bf76-c751854c915c req-eb6890af-9336-459b-8054-8d80a27c308a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.954091 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bc3dd4f4-a59a-4b2a-bf76-c751854c915c req-eb6890af-9336-459b-8054-8d80a27c308a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 943 time: 0.4034798 May 25 15:42:06.959484 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55066) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:06.963582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=686f6b47-320a-4c37-bb8f-ba8b0031f50d,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:06.964093 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-ee5ca056-b173-47e7-86e5-e60cf0ce1aa3 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0541055 May 25 15:42:06.969929 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-e5f89d4e-3721-4203-bb49-fa9b5e575b3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.971871 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-e5f89d4e-3721-4203-bb49-fa9b5e575b3d service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.3811743 May 25 15:42:06.972131 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.974978 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-4b585c71-c929-4459-bb73-5607c00cec8b service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4626780 May 25 15:42:06.987982 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84', 'status': 'completed', 'code': 200} May 25 15:42:07.031099 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 6b61c077-8a57-453b-88d9-aaea2e17596f up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:07.124505 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 6b61c077-8a57-453b-88d9-aaea2e17596f completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:07.132451 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 6b61c077-8a57-453b-88d9-aaea2e17596f triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:07.133026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.203871 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bc3dd4f4-a59a-4b2a-bf76-c751854c915c req-fb243457-ecbb-4525-8976-54b4c1ef54d0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2295136 May 25 15:42:07.248996 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-8ecdd684-ba2a-49a9-bc4d-1c58b5ef9f96 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 217 time: 0.2373939 May 25 15:42:07.255966 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.285663 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.301611 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.355915 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.365815 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-4f8288cf-a600-413f-8ff5-013dc781da57 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3568897 May 25 15:42:07.366339 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=6b61c077-8a57-453b-88d9-aaea2e17596f,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:07.367357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:07.375689 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.376944 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.378893 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.390255 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-91c3ad12-9faf-4e04-857c-69d2f884a47a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.418398 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd60989-3766-4192-b6c7-a05bc2e65882 req-0cf93e3d-03ad-4419-a547-f4cc00871267 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.420040 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bdd60989-3766-4192-b6c7-a05bc2e65882 req-0cf93e3d-03ad-4419-a547-f4cc00871267 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 943 time: 0.2999637 May 25 15:42:07.480456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:07.494084 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.501615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-802e18dc-60a3-4698-824d-3ac00dbdbcf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.503150 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-802e18dc-60a3-4698-824d-3ac00dbdbcf3 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.2387693 May 25 15:42:07.511070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=959e46a6-2c4e-4ba8-9b0d-deabfd347b18,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:07.514732 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.553905 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-77f326cb-fdd8-4ca8-a46d-afbb4f8d6c29 req-bff53672-9dff-45a2-978e-3929c99a4cf8 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5370252 May 25 15:42:07.561574 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=40ecb10ba55142a78102643c5cbd56d9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9502993 May 25 15:42:07.567212 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55084) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:07.588038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.612819 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.646049 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.652105 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=686f6b47-320a-4c37-bb8f-ba8b0031f50d,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:07.672513 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-9ed13aba-c209-4a99-861f-ce286dabf346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.673986 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-9ed13aba-c209-4a99-861f-ce286dabf346 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1583483 May 25 15:42:07.680810 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.695640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bdd60989-3766-4192-b6c7-a05bc2e65882 req-5bd6ab64-921d-4678-b2c3-4000d5a6d45f tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2092450 May 25 15:42:07.706511 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.709956 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/686f6b47-320a-4c37-bb8f-ba8b0031f50d HTTP/1.1" status: 204 len: 168 time: 0.7471523 May 25 15:42:07.726625 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-40821211-0454-4dc7-a0f1-babfecdf0f8c req-8bee7d99-3141-4298-a5b1-abdb5c94131d service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3472970 May 25 15:42:07.749255 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dca280ab-cac2-439d-9d43-18cfd39fa9d0 req-376fbaa2-43dd-4cb7-b4ee-e9402790823f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.750768 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dca280ab-cac2-439d-9d43-18cfd39fa9d0 req-376fbaa2-43dd-4cb7-b4ee-e9402790823f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.2633502 May 25 15:42:07.752625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.801539 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f', 'code': 200} May 25 15:42:07.827529 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dca280ab-cac2-439d-9d43-18cfd39fa9d0 req-6fa199d9-2bd5-4d61-b1c3-7eabeab7d71b tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683846 May 25 15:42:07.943413 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-0e41b323-9882-47a0-89c7-d786127285b0 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2559834 May 25 15:42:07.952953 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:07.962701 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.064607 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a860ed65-b82d-41a3-b133-7487b97175da req-19bb26ad-8aa1-4dab-8734-0f66a9b4a012 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.067149 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-19bb26ad-8aa1-4dab-8734-0f66a9b4a012 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1096 time: 0.1221747 May 25 15:42:08.130974 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=959e46a6-2c4e-4ba8-9b0d-deabfd347b18,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:08.147808 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.202867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:08.205091 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/959e46a6-2c4e-4ba8-9b0d-deabfd347b18 HTTP/1.1" status: 204 len: 168 time: 0.6361792 May 25 15:42:08.364453 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-fcbfed89-efbb-460c-bc97-0be2614d85bf service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4000835 May 25 15:42:08.422722 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a06786b-4f3b-42f9-9b0b-9af4afb83629 req-cb9a31c2-44fa-4416-a47e-b9fd413219fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.424893 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2a06786b-4f3b-42f9-9b0b-9af4afb83629 req-cb9a31c2-44fa-4416-a47e-b9fd413219fa service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.1593890 May 25 15:42:08.469524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55124) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:08.504672 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a860ed65-b82d-41a3-b133-7487b97175da req-2ee0a2b5-285c-409f-8541-f46440f38691 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.506527 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-2ee0a2b5-285c-409f-8541-f46440f38691 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.4301076 May 25 15:42:08.518013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:08.583052 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2a06786b-4f3b-42f9-9b0b-9af4afb83629 req-ab37904f-9b84-4481-b0e8-6e47de36ebca service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1359463 May 25 15:42:08.597418 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:08.605556 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Usage tracker for resource:security_group_rule and tenant:e9e567d738294091ad15f1655d47316d is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:08.609537 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-f956ef03-a613-41cd-bcfc-18602e6ce25c service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.0901823 May 25 15:42:08.614435 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:08.621929 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:08.654369 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00887915-3233-468e-94ad-04736787316f req-5c46777b-64e0-4e9d-b6d4-86ffae2ec213 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.659086 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00887915-3233-468e-94ad-04736787316f req-5c46777b-64e0-4e9d-b6d4-86ffae2ec213 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 944 time: 0.3882720 May 25 15:42:08.724567 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00887915-3233-468e-94ad-04736787316f req-abbdaf9d-964a-43ce-ad66-74ce6df748e5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599058 May 25 15:42:08.821211 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:08.830797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:08.885495 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.900594 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e9e567d738294091ad15f1655d47316d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4259598 May 25 15:42:08.901219 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55150) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:08.945891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=950e4658-b005-4111-9b1f-f10edbf633df,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:08.949049 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.998854 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.030098 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.038568 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fc98b49d-704b-4dfb-bedd-e8a999ed769b details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:09.069111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78084810-83c7-4332-b258-03a471979ea9 req-0e2c1dd2-c88f-49a7-ac71-6c22ad184d39 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:09.076874 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-78084810-83c7-4332-b258-03a471979ea9 req-0e2c1dd2-c88f-49a7-ac71-6c22ad184d39 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 943 time: 0.2088709 May 25 15:42:09.104382 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.110202 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-10fbc8a5-e5b5-40f6-827f-66df283a997f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.131434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=950e4658-b005-4111-9b1f-f10edbf633df,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:09.136855 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.157199 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.162709 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/950e4658-b005-4111-9b1f-f10edbf633df HTTP/1.1" status: 204 len: 168 time: 0.2606807 May 25 15:42:09.189994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06062e89-fdab-4f06-bdd6-9c8a20279ec3 req-624d3dae-79fd-4428-979c-a489355dd73a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:09.189994 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-06062e89-fdab-4f06-bdd6-9c8a20279ec3 req-624d3dae-79fd-4428-979c-a489355dd73a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 943 time: 0.2208369 May 25 15:42:09.192780 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a860ed65-b82d-41a3-b133-7487b97175da req-c403b32a-20bc-47cf-b497-1523912b8e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:09.194100 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-c403b32a-20bc-47cf-b497-1523912b8e3c service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.1150353 May 25 15:42:09.204878 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-78084810-83c7-4332-b258-03a471979ea9 req-2bc4ea34-ee0d-48c8-9de4-f04f47053eb4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1266346 May 25 15:42:09.299133 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-06062e89-fdab-4f06-bdd6-9c8a20279ec3 req-0a698b9d-f511-449a-a33e-b42f22bf0907 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932014 May 25 15:42:09.343666 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:09.353930 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-f96cf9f3-ddca-41bf-bfed-4bf6037993c3 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483227 May 25 15:42:09.388991 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'port_id': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'mac_address': 'fa:16:3e:b7:8c:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 834, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:09.499007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.557397 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fc98b49d-704b-4dfb-bedd-e8a999ed769b {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:09.575584 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:09.583712 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:09.585491 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 4db5be42-79ac-4400-b3f9-ff41ef933d17 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:09.593726 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c42a0691-21f5-41ce-b3bd-7feefea67fd3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.702363 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-93a7420c-dd96-4ad6-999f-811324652d97 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3331001 May 25 15:42:09.765181 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:09.768398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.878284 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:09.914583 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55196) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:09.921189 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'port_id': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'mac_address': 'fa:16:3e:9d:86:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 800, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:10.017576 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a860ed65-b82d-41a3-b133-7487b97175da req-feee102f-81c7-438d-8771-2c36bf75af6e service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3019722 May 25 15:42:10.036162 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.048248 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95898098-d8b9-4511-8d1f-d5b0755c0714 req-ee4061bb-e495-4f44-b18f-e371acada092 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:10.060494 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4db5be42-79ac-4400-b3f9-ff41ef933d17 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:10.068618 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-95898098-d8b9-4511-8d1f-d5b0755c0714 req-ee4061bb-e495-4f44-b18f-e371acada092 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 944 time: 0.1677392 May 25 15:42:10.087684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:10.094932 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.098067 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.114833 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-95898098-d8b9-4511-8d1f-d5b0755c0714 req-cf46f034-0276-459f-b73f-634c1dcc02bb tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451880 May 25 15:42:10.199174 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:10.205513 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.212581 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.228315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:10.232466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Usage tracker for resource:security_group_rule and tenant:91da1581ed084932a561c13962772393 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:10.235446 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:10.242035 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:10.361948 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.368082 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.379320 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-99a02c98-bc86-4b86-9677-b53957898975 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.426121 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=994f6031-8b4c-44a8-85b4-a9d081a153e0,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:10.438703 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9757dae8-ee3c-4a2b-81f4-fe5363a9043f req-021606e6-f0a2-4df1-9894-9562f494e74b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:10.446154 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9757dae8-ee3c-4a2b-81f4-fe5363a9043f req-021606e6-f0a2-4df1-9894-9562f494e74b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 944 time: 0.1155791 May 25 15:42:10.448982 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=91da1581ed084932a561c13962772393&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5333457 May 25 15:42:10.451379 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.453095 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55230) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:10.509739 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9757dae8-ee3c-4a2b-81f4-fe5363a9043f req-a151a57f-0f73-499e-9979-c08fb01c7dd8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0625877 May 25 15:42:10.547686 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.584892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.668194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.679588 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e133eb3f-8370-4f6b-9086-d7e4937f6aa6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.715818 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=994f6031-8b4c-44a8-85b4-a9d081a153e0,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:10.725989 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.726845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55240) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:10.742688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.743800 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/994f6031-8b4c-44a8-85b4-a9d081a153e0 HTTP/1.1" status: 204 len: 168 time: 0.2897787 May 25 15:42:10.764214 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05ecd36-5c75-48cd-9e6d-be9a71ea29b7 req-af18e57d-9aa7-42a8-b1fc-3bb53683d5d7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:10.772833 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e05ecd36-5c75-48cd-9e6d-be9a71ea29b7 req-af18e57d-9aa7-42a8-b1fc-3bb53683d5d7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 943 time: 0.1070135 May 25 15:42:10.814608 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e05ecd36-5c75-48cd-9e6d-be9a71ea29b7 req-c221605a-276e-4b42-80db-07e67f35ee4b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409291 May 25 15:42:10.947452 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['fc98b49d-704b-4dfb-bedd-e8a999ed769b'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:10.992946 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['4db5be42-79ac-4400-b3f9-ff41ef933d17'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:11.098524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1549872095-network', 'tenant_id': 'd7112359f9e947e3ae4f12025d5ca5af'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:11.104080 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:11.116469 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Usage tracker for resource:network and tenant:d7112359f9e947e3ae4f12025d5ca5af is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:11.119376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:11.125713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:11.137465 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Made reservation on behalf of d7112359f9e947e3ae4f12025d5ca5af for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:11.140960 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.158802 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.179283 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:11.185110 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Usage tracker for resource:security_group_rule and tenant:d7112359f9e947e3ae4f12025d5ca5af is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:11.189236 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:11.196489 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:11.320056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.321388 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55258) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:11.341595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.347821 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b7241d52-b9ac-4796-b9e9-439bb2a4883e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.356551 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.374381 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b64209-8c6f-45a6-8dc8-840ee2d4e631 req-49ee361f-d6cb-4a0c-bfc5-f9d4ad6c7bc7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:11.375928 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-35b64209-8c6f-45a6-8dc8-840ee2d4e631 req-49ee361f-d6cb-4a0c-bfc5-f9d4ad6c7bc7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 945 time: 0.0890491 May 25 15:42:11.392626 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] vlan segment allocate from pool success with {'vlan_id': 841, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:11.398651 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:11.407359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b2435db-3eb8-4730-8ccf-cadc6791a024,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:11.410454 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.411618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Usage tracker for resource:security_group_rule and tenant:e635a6e6bccd4b2c8aff13ad46ec3432 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:11.415375 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:11.422353 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.422678 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Added segment 38748490-d124-4961-b1a8-deb796932972 of type vlan for network 5c22fd88-c707-4a76-88a0-593fe9b22cc6 May 25 15:42:11.423992 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:11.428786 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-35b64209-8c6f-45a6-8dc8-840ee2d4e631 req-54b09a0d-e3dd-46a2-80fb-eea1dbe3fc89 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463877 May 25 15:42:11.468882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.518687 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.523882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:11.524475 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.533506 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8a2fdc47-dc91-4ceb-8093-6843cc0f0047 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.661423 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Pushing event updated for resources: {'Network': ['ID=5c22fd88-c707-4a76-88a0-593fe9b22cc6,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:11.664650 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.669096 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9412274 May 25 15:42:11.671101 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.671992 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55272) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:11.676194 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 5c22fd88-c707-4a76-88a0-593fe9b22cc6 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:11.679135 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Request body: {'subnet': {'network_id': '5c22fd88-c707-4a76-88a0-593fe9b22cc6', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1549872095-subnet', 'tenant_id': 'd7112359f9e947e3ae4f12025d5ca5af', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:11.690063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.699807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:11.703905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f9dfdbee-28f0-4bda-95fd-0f86af2c00a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.717040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Usage tracker for resource:subnet and tenant:d7112359f9e947e3ae4f12025d5ca5af is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:11.727579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9105bddd-ad7b-453e-aef9-8875efcbb601 req-0df7d8e7-4236-485e-ba92-c6aee9ef535d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:11.727819 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:11.729419 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9105bddd-ad7b-453e-aef9-8875efcbb601 req-0df7d8e7-4236-485e-ba92-c6aee9ef535d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 944 time: 0.1022429 May 25 15:42:11.746343 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:11.757508 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e635a6e6bccd4b2c8aff13ad46ec3432&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4349539 May 25 15:42:11.761933 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55276) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:11.765006 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=149f7ba7-213d-478f-b142-62148ac1675e,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:11.779199 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.795519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Made reservation on behalf of d7112359f9e947e3ae4f12025d5ca5af for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:11.797841 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.822124 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9105bddd-ad7b-453e-aef9-8875efcbb601 req-fb89675e-8565-4cd5-97e5-ee6f4f6735e4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0871680 May 25 15:42:11.958241 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.022812 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.042456 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574ee975-8d77-4b01-abb6-39bb008a8432 req-13144804-b3a8-4f15-a53b-c0a133ffceab tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:12.044849 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-574ee975-8d77-4b01-abb6-39bb008a8432 req-13144804-b3a8-4f15-a53b-c0a133ffceab tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 943 time: 0.1012626 May 25 15:42:12.095446 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-574ee975-8d77-4b01-abb6-39bb008a8432 req-199fcdd4-6fd9-46d7-b003-c57917ae13f3 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413065 May 25 15:42:12.193741 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.198937 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.231023 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=149f7ba7-213d-478f-b142-62148ac1675e,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:12.233384 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.293005 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.294157 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/149f7ba7-213d-478f-b142-62148ac1675e HTTP/1.1" status: 204 len: 168 time: 0.5305977 May 25 15:42:12.355055 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55302) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:12.429698 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.434984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.501526 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.522112 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b546f21d-4510-446e-9694-4d46efe8a426,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:12.523751 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:12.524200 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Checking segment: {'id': '38748490-d124-4961-b1a8-deb796932972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 841, 'network_id': '5c22fd88-c707-4a76-88a0-593fe9b22cc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:12.524617 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Network hostable DHCP agents. Network: 5c22fd88-c707-4a76-88a0-593fe9b22cc6, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:12.527715 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Usage tracker for resource:security_group_rule and tenant:ee7342c0f9cd45a9993685422be7021f is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:12.529519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.537720 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:12.545323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Network 5c22fd88-c707-4a76-88a0-593fe9b22cc6 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:12.545647 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:12.560862 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 5c22fd88-c707-4a76-88a0-593fe9b22cc6) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:12.570663 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-548e7a12-4afb-4fdb-a608-77146e435ca7 None None] Network 5c22fd88-c707-4a76-88a0-593fe9b22cc6 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:12.583979 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:12.584713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.612658 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.9392505 May 25 15:42:12.722459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db678deb-47b8-468a-95f9-e7e1db0a0801 req-e14b184c-9fcd-41ca-891d-cda1ec7ccce7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:12.723965 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db678deb-47b8-468a-95f9-e7e1db0a0801 req-e14b184c-9fcd-41ca-891d-cda1ec7ccce7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 945 time: 0.1445663 May 25 15:42:12.732624 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.752295 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:12.766034 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.823199 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ee7342c0f9cd45a9993685422be7021f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4670300 May 25 15:42:12.826168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55322) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:12.826779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de17f62f-6890-4917-8bbe-ba4bf9c5c070,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:12.832450 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db678deb-47b8-468a-95f9-e7e1db0a0801 req-f72bc4d4-be93-4858-9984-70d5e726dd29 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1020114 May 25 15:42:12.833339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.854661 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-690f5e96-c4ea-4421-82a0-7f3110c28307 None None] Network 5c22fd88-c707-4a76-88a0-593fe9b22cc6 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:12.958720 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.021013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.094347 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.096476 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c95052e-a6ed-4e09-b3ae-0e29434843a6 req-aab4cfc4-a821-45cf-8327-6fde29343078 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:13.098218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3c95052e-a6ed-4e09-b3ae-0e29434843a6 req-aab4cfc4-a821-45cf-8327-6fde29343078 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 944 time: 0.0907989 May 25 15:42:13.099707 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-30c908d6-4a59-456d-9466-d7b0cd5b02cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.126278 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 470d8e34-1962-4b04-9960-85526f36bc84 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:13.135957 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de17f62f-6890-4917-8bbe-ba4bf9c5c070,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:13.138940 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.140028 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.143900 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/de17f62f-6890-4917-8bbe-ba4bf9c5c070 HTTP/1.1" status: 204 len: 168 time: 0.3160059 May 25 15:42:13.144902 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fc98b49d-704b-4dfb-bedd-e8a999ed769b up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:13.206147 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3c95052e-a6ed-4e09-b3ae-0e29434843a6 req-3949a939-4a49-48f4-bbd7-28c72d89467c tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0985050 May 25 15:42:13.338513 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port fc98b49d-704b-4dfb-bedd-e8a999ed769b completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:13.350725 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port fc98b49d-704b-4dfb-bedd-e8a999ed769b triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:13.351156 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.367308 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e936f4-970d-44a9-945d-27482ebfab0e req-21d39384-90a8-485c-8cf8-aad5fa85141b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:13.369305 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-85e936f4-970d-44a9-945d-27482ebfab0e req-21d39384-90a8-485c-8cf8-aad5fa85141b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 943 time: 0.0967219 May 25 15:42:13.416329 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=470d8e34-1962-4b04-9960-85526f36bc84,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:13.428850 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-85e936f4-970d-44a9-945d-27482ebfab0e req-bfd24f29-8835-4741-b406-ba8e5156d51d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538185 May 25 15:42:13.439390 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '470d8e34-1962-4b04-9960-85526f36bc84', 'network_id': 'e2c8de13-6b38-480d-a253-7798199b43d7', 'port_id': '470d8e34-1962-4b04-9960-85526f36bc84', 'mac_address': 'fa:16:3e:d1:5f:23', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 845, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0eddaf48-c485-4fd6-aa56-c8209ff2711a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:13.582759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.610127 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 470d8e34-1962-4b04-9960-85526f36bc84 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:13.610231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55358) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:13.614000 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.623718 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-917479112-network', 'tenant_id': 'bf0c84df4fac4f2fb02e003374cafe9f'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:13.630596 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:13.635302 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Usage tracker for resource:network and tenant:bf0c84df4fac4f2fb02e003374cafe9f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:13.639075 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:13.643611 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=470d8e34-1962-4b04-9960-85526f36bc84,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:13.645902 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:13.653895 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:13.660471 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.663647 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-fa3b9950-b2df-4e06-8102-e22f19bcfa0f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.686000 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Made reservation on behalf of bf0c84df4fac4f2fb02e003374cafe9f for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:13.689286 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.698962 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:13.704255 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55364) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:13.714556 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.715420 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 4db5be42-79ac-4400-b3f9-ff41ef933d17 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:13.716450 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.723568 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.742962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:13.744729 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'code': 200} May 25 15:42:13.748141 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Usage tracker for resource:security_group_rule and tenant:b15f265172ea44c6ade012061183772a is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:13.749123 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:13.750869 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:13.754622 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Usage tracker for resource:security_group_rule and tenant:bf0c84df4fac4f2fb02e003374cafe9f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:13.757366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:13.758510 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:13.766277 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:13.791539 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:13.795450 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.795961 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.048s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.863515 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.870406 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.885472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:13.889254 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 4db5be42-79ac-4400-b3f9-ff41ef933d17 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:13.892602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.895058 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 4db5be42-79ac-4400-b3f9-ff41ef933d17 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:13.895436 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.909280 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.916763 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.918520 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-29941af8-8730-41c0-892e-a869faaa594b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.934208 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3c30a064-43be-4cc3-834f-b2b731e067d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.977233 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] vlan segment allocate from pool success with {'vlan_id': 824, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:13.990915 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ebdc88c-d6e2-496c-8023-bee18f909780,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:13.995224 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.996225 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:13.996562 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Added segment e9166690-fefd-42fa-a6cd-1c94450d3363 of type vlan for network 44aa62f4-dc01-435b-bf01-a88d1d83c9a0 May 25 15:42:14.024847 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b15f265172ea44c6ade012061183772a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3168657 May 25 15:42:14.024847 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a687a18c-5d63-4d5a-b04c-3b394fe59193,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:14.027090 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.027795 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55374) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:14.036318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.092573 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.094373 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.095194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.098885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.110801 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.179441 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:14.188211 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.191436 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.216807 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6056020 May 25 15:42:14.217900 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Pushing event updated for resources: {'Network': ['ID=44aa62f4-dc01-435b-bf01-a88d1d83c9a0,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:14.220138 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55380) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:14.223146 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.227258 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Request body: {'subnet': {'network_id': '44aa62f4-dc01-435b-bf01-a88d1d83c9a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-917479112-subnet', 'tenant_id': 'bf0c84df4fac4f2fb02e003374cafe9f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:14.232943 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:14.236957 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Usage tracker for resource:subnet and tenant:bf0c84df4fac4f2fb02e003374cafe9f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:14.240204 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:14.245988 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:14.256616 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.262493 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Made reservation on behalf of bf0c84df4fac4f2fb02e003374cafe9f for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:14.265790 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.281453 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a3dc0c-eef8-4938-9446-9c50f714e049 req-85228456-f5f3-4308-b184-f731f1a0d174 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.282936 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e0a3dc0c-eef8-4938-9446-9c50f714e049 req-85228456-f5f3-4308-b184-f731f1a0d174 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 945 time: 0.2319231 May 25 15:42:14.303729 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:14.306836 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 44aa62f4-dc01-435b-bf01-a88d1d83c9a0 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:14.320619 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.370405 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef249f10-b4aa-4e90-9a99-90b56fc7fb04 req-680637c9-52d0-4c1e-b2ce-d438f9843dec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.372447 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ef249f10-b4aa-4e90-9a99-90b56fc7fb04 req-680637c9-52d0-4c1e-b2ce-d438f9843dec service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1098 time: 0.2383416 May 25 15:42:14.381641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.383859 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['470d8e34-1962-4b04-9960-85526f36bc84'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:14.498212 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e0a3dc0c-eef8-4938-9446-9c50f714e049 req-d3bb8b0b-46da-4a63-b3a2-a1c35c52126b tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2049496 May 25 15:42:14.528269 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ef249f10-b4aa-4e90-9a99-90b56fc7fb04 req-a5ff5182-2354-4f90-b6c5-31b1934cecfd service neutron] Synchronizing usage tracker for tenant:c1e4dad1b2de4697bcce69b7b2bf68f6 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:14.553600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.561734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.665719 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a687a18c-5d63-4d5a-b04c-3b394fe59193,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:14.669103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.669968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ef249f10-b4aa-4e90-9a99-90b56fc7fb04 req-a5ff5182-2354-4f90-b6c5-31b1934cecfd service neutron] Unset dirty status for tenant:c1e4dad1b2de4697bcce69b7b2bf68f6 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:14.671993 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ef249f10-b4aa-4e90-9a99-90b56fc7fb04 req-a5ff5182-2354-4f90-b6c5-31b1934cecfd service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2337668 May 25 15:42:14.686476 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd272a6-9980-45dd-90fa-7bddfb5c3599 req-78124c58-6771-4bdb-9fe3-771745946c1e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.688377 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9bd272a6-9980-45dd-90fa-7bddfb5c3599 req-78124c58-6771-4bdb-9fe3-771745946c1e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.3243759 May 25 15:42:14.694934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:14.696201 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a687a18c-5d63-4d5a-b04c-3b394fe59193 HTTP/1.1" status: 204 len: 168 time: 0.6674201 May 25 15:42:14.755227 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9bd272a6-9980-45dd-90fa-7bddfb5c3599 req-33bb5616-01f2-4642-835c-215496f02f62 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574481 May 25 15:42:14.948181 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645b7955-2f3e-40ad-8a21-8f1b9743e60b req-cb7b4c83-3388-4383-9a52-8d511cae4805 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.949629 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-645b7955-2f3e-40ad-8a21-8f1b9743e60b req-cb7b4c83-3388-4383-9a52-8d511cae4805 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 944 time: 0.0871415 May 25 15:42:14.999295 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-645b7955-2f3e-40ad-8a21-8f1b9743e60b req-77e78562-fa49-4e8e-adf3-b55fe29a3644 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412064 May 25 15:42:15.053013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.059918 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c396b5f6-8eb0-42ed-add3-47bf7886f2a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.179658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=a81be0c1-2b95-408e-8648-21cb51a49058,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:15.182952 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Checking segment: {'id': 'e9166690-fefd-42fa-a6cd-1c94450d3363', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '44aa62f4-dc01-435b-bf01-a88d1d83c9a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:15.183464 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Network hostable DHCP agents. Network: 44aa62f4-dc01-435b-bf01-a88d1d83c9a0, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:15.188399 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:15.213186 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Network 44aa62f4-dc01-435b-bf01-a88d1d83c9a0 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:15.229177 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 44aa62f4-dc01-435b-bf01-a88d1d83c9a0) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:15.246266 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:15.246743 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f97ce3a-86fa-4133-b7ff-bd4f4f0507f4 None None] Network 44aa62f4-dc01-435b-bf01-a88d1d83c9a0 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:15.247313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.271113 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-126b8452-57d8-48e5-9e15-1fa57b7c3b9d admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0498528 May 25 15:42:15.459597 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c220d80d-8b19-4a1b-8030-fdd995a57584 None None] Network 44aa62f4-dc01-435b-bf01-a88d1d83c9a0 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:15.742174 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86208b49-3dbe-4d69-8152-b3a3ef8b1f70 req-219a789b-0957-4f53-b739-c321bea42716 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:15.743657 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-86208b49-3dbe-4d69-8152-b3a3ef8b1f70 req-219a789b-0957-4f53-b739-c321bea42716 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0876412 May 25 15:42:15.746290 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:15.819786 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-86208b49-3dbe-4d69-8152-b3a3ef8b1f70 req-654596ba-7741-4c3e-bd10-adce381cbb5d tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546401 May 25 15:42:15.836740 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'code': 200} May 25 15:42:16.066810 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea58993-c89d-4ccc-927c-ddfa69439819 req-95a02fc2-b3ca-41e2-8c7a-0c0c7d1ac995 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:16.074677 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9ea58993-c89d-4ccc-927c-ddfa69439819 req-95a02fc2-b3ca-41e2-8c7a-0c0c7d1ac995 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.1194336 May 25 15:42:16.132036 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9ea58993-c89d-4ccc-927c-ddfa69439819 req-e264ff28-1bd3-42e2-b17c-a44d821e5250 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545421 May 25 15:42:16.263496 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c80f7f-fb0a-4982-8168-6cb46e0c7fe9 req-4c387ebf-322d-46ec-adfe-ca4226b99222 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:16.270260 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-45c80f7f-fb0a-4982-8168-6cb46e0c7fe9 req-4c387ebf-322d-46ec-adfe-ca4226b99222 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 944 time: 0.1187122 May 25 15:42:16.369534 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-45c80f7f-fb0a-4982-8168-6cb46e0c7fe9 req-ff0288c7-566e-4bd8-8d56-1f31389dcc92 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983405 May 25 15:42:16.400371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b79d29d-868e-4a85-9fac-b181c59d911b req-f4d3f5cd-77f0-4c95-9450-e2255d1364a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:16.401915 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b79d29d-868e-4a85-9fac-b181c59d911b req-f4d3f5cd-77f0-4c95-9450-e2255d1364a7 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1099 time: 0.1169972 May 25 15:42:16.458545 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b79d29d-868e-4a85-9fac-b181c59d911b req-aded64cd-f53b-4b1b-b693-6f8df6cfa79c service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382791 May 25 15:42:17.007999 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5021eb70-16e3-42ad-9802-716c87d063de req-0de2920e-528e-420d-9476-2d1b426c17f7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:17.009334 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5021eb70-16e3-42ad-9802-716c87d063de req-0de2920e-528e-420d-9476-2d1b426c17f7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0790453 May 25 15:42:17.051975 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5021eb70-16e3-42ad-9802-716c87d063de req-2337f675-22f1-4a1e-ba58-274e0501058f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364246 May 25 15:42:17.102810 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 470d8e34-1962-4b04-9960-85526f36bc84 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:17.169664 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 470d8e34-1962-4b04-9960-85526f36bc84 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:17.174148 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 470d8e34-1962-4b04-9960-85526f36bc84 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:17.174528 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.294836 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.315480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9820d5aa-d88b-43aa-abf7-9b8302d38b3f req-13e231f3-8957-4528-b563-ea47cacd5a23 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:17.320174 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9820d5aa-d88b-43aa-abf7-9b8302d38b3f req-13e231f3-8957-4528-b563-ea47cacd5a23 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.0868802 May 25 15:42:17.327985 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=470d8e34-1962-4b04-9960-85526f36bc84,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:17.335683 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.338195 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.365120 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9820d5aa-d88b-43aa-abf7-9b8302d38b3f req-679f613d-6a89-41c5-91d5-36f6b6edec00 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423982 May 25 15:42:17.427624 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:17.430854 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.566128 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1079f7-f86e-4124-93e3-78ea460e6c64 req-2e5c2fd8-d8a4-4e42-a27f-37044b90e6fa tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:17.567423 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5f1079f7-f86e-4124-93e3-78ea460e6c64 req-2e5c2fd8-d8a4-4e42-a27f-37044b90e6fa tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0816956 May 25 15:42:17.620123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5f1079f7-f86e-4124-93e3-78ea460e6c64 req-4ba5d2eb-d0e6-401c-a9c4-06cee4339c00 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468745 May 25 15:42:17.838122 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:17.889539 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84', 'code': 200} May 25 15:42:18.278845 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8269c5cd-c2f1-4180-9ae3-5298ee13dda7 req-f4387e80-7107-4735-9c64-c5b7e9b2dade tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.280290 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8269c5cd-c2f1-4180-9ae3-5298ee13dda7 req-f4387e80-7107-4735-9c64-c5b7e9b2dade tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.1186230 May 25 15:42:18.347321 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8269c5cd-c2f1-4180-9ae3-5298ee13dda7 req-9ba3a007-027a-45be-a690-fce33ea83013 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0612223 May 25 15:42:18.355923 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb11471-1d5e-4adc-8a14-06c3c242da74 req-a139f88c-75a1-4ac8-99a4-999266e50751 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.357332 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbb11471-1d5e-4adc-8a14-06c3c242da74 req-a139f88c-75a1-4ac8-99a4-999266e50751 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.1156685 May 25 15:42:18.422341 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbb11471-1d5e-4adc-8a14-06c3c242da74 req-8000b250-f6e0-4c8a-9d98-deecb06683b3 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376508 May 25 15:42:18.556571 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5f6d86-335b-4809-a12d-8d5a6b93b733 req-6ed928ae-9ed4-4efd-97f0-8d0c93af7d1b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.557968 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6a5f6d86-335b-4809-a12d-8d5a6b93b733 req-6ed928ae-9ed4-4efd-97f0-8d0c93af7d1b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.0775270 May 25 15:42:18.607346 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6a5f6d86-335b-4809-a12d-8d5a6b93b733 req-8649d844-a13e-44e8-a3ec-64d9f7899c80 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432084 May 25 15:42:18.860744 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad9bd9-3292-4be5-840d-4a4b31993b83 req-7c000693-3f60-4996-8575-ac7f003f5abb tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.862129 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-65ad9bd9-3292-4be5-840d-4a4b31993b83 req-7c000693-3f60-4996-8575-ac7f003f5abb tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.1436188 May 25 15:42:18.870912 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55520) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.871424 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc44c65-9458-4ac2-89b3-af3005caeb71 req-700d0ff1-d323-46f5-8219-ef4b57b3d39d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.873277 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bfc44c65-9458-4ac2-89b3-af3005caeb71 req-700d0ff1-d323-46f5-8219-ef4b57b3d39d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1204267 May 25 15:42:18.887235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'floatingip': {'port_id': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.919716 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bfc44c65-9458-4ac2-89b3-af3005caeb71 req-d0e42f36-8a7e-4423-96c7-8bedf7af131b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403855 May 25 15:42:18.971954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.547761 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b5a985-34e3-4ee5-b0f6-4a875c2408ad req-7228b248-5c52-4f6a-8c50-fb82daa5aab4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:19.549501 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-34b5a985-34e3-4ee5-b0f6-4a875c2408ad req-7228b248-5c52-4f6a-8c50-fb82daa5aab4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0858698 May 25 15:42:19.600972 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-34b5a985-34e3-4ee5-b0f6-4a875c2408ad req-6b93c21d-f1a2-4691-8b93-1b1801c6aee4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401602 May 25 15:42:19.866905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.873618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.054077 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.l3_db [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Floating IP e0e23f1b-e60a-4257-881a-d0c6cf4e4300 associated. External IP: 172.27.1.100, port: fc98b49d-704b-4dfb-bedd-e8a999ed769b. May 25 15:42:20.165755 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693d4333-cc38-4127-b674-3d1b0b1c56e6 req-3cb5163d-a30a-49bf-abf5-ba6a34627d56 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.167250 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-693d4333-cc38-4127-b674-3d1b0b1c56e6 req-3cb5163d-a30a-49bf-abf5-ba6a34627d56 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1009283 May 25 15:42:20.225564 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-693d4333-cc38-4127-b674-3d1b0b1c56e6 req-4afa17ab-ff20-400b-bc7e-09bde350781c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502841 May 25 15:42:20.444421 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:42:20.764045 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:20.768555 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.781165 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:20.793253 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:20.795029 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:42:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:20.823153 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-d6b908d0-5fee-4037-9813-17ff6102e9a4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "PUT /v2.0/floatingips/e0e23f1b-e60a-4257-881a-d0c6cf4e4300 HTTP/1.1" status: 200 len: 991 time: 1.9500241 May 25 15:42:20.823795 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:20.847141 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1ac8b7-4e80-4373-bebc-a5678c18a4b5 req-29604edb-db0e-4976-9730-206b93b0445d tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.848625 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c1ac8b7-4e80-4373-bebc-a5678c18a4b5 req-29604edb-db0e-4976-9730-206b93b0445d tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0919926 May 25 15:42:20.895324 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c1ac8b7-4e80-4373-bebc-a5678c18a4b5 req-9f6501d6-8c38-41d4-a59a-0f368ce9f5e5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401919 May 25 15:42:20.950049 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'status': 'completed', 'code': 200} May 25 15:42:20.991951 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:21.123858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e192f4-adc2-4ff7-9924-929d5452aa84 req-41062785-3253-435f-9366-02566ef1a75c tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.125317 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-23e192f4-adc2-4ff7-9924-929d5452aa84 req-41062785-3253-435f-9366-02566ef1a75c tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0976923 May 25 15:42:21.137139 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55592) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:21.143276 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'floatingip': {'port_id': '4db5be42-79ac-4400-b3f9-ff41ef933d17'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:21.214590 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-268ab663-db9f-44f5-9e78-230f14a45351 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.222997 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.227542 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-268ab663-db9f-44f5-9e78-230f14a45351 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1098 time: 0.0979521 May 25 15:42:21.431461 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'e0e23f1b-e60a-4257-881a-d0c6cf4e4300', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.100', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 133, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:b7:8c:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:46Z', 'updated_at': '2021-05-25T15:42:19Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:21.436712 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:21.444804 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:21.445392 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:42:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:21.515309 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-1e9965fe-4aa7-411c-b8bf-f83b44a60cff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.516849 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-1e9965fe-4aa7-411c-b8bf-f83b44a60cff service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.2724960 May 25 15:42:21.532864 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb90c998-540c-4174-9049-2ef24fc67f00 req-16a59c70-a6d4-4145-9655-d1875fe82623 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.534461 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eb90c998-540c-4174-9049-2ef24fc67f00 req-16a59c70-a6d4-4145-9655-d1875fe82623 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1372547 May 25 15:42:21.583060 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eb90c998-540c-4174-9049-2ef24fc67f00 req-6f7befd4-f089-434d-bb5b-d8b3016e7ad2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420034 May 25 15:42:21.625393 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:21.898813 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-85f0b8be-bd27-42cb-a1f9-2d6207f0bf3e service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 999 time: 0.1531785 May 25 15:42:21.925093 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.929263 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.098261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-21d31c65-8fdf-4407-a9a6-3572387a8fee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:22.104949 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-21d31c65-8fdf-4407-a9a6-3572387a8fee service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.1411529 May 25 15:42:22.152122 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.l3_db [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Floating IP 01b3f2a3-f643-46f9-b308-8bf7a8b4f106 associated. External IP: 172.27.1.232, port: 4db5be42-79ac-4400-b3f9-ff41ef933d17. May 25 15:42:22.181751 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'e0e23f1b-e60a-4257-881a-d0c6cf4e4300', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.100', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 133, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:b7:8c:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:46Z', 'updated_at': '2021-05-25T15:42:19Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:22.186869 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ad05593-1ecf-4095-b4f6-0abf22e2c0e4 None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'e0e23f1b-e60a-4257-881a-d0c6cf4e4300', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.100', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 133, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:b7:8c:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:46Z', 'updated_at': '2021-05-25T15:42:19Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:22.423477 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-66160126-7856-4780-ad3b-fe0f7f06baf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:22.424958 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-66160126-7856-4780-ad3b-fe0f7f06baf5 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2980468 May 25 15:42:22.441214 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-cd4c7692-4566-4893-a72a-ab04276f5989 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:22.442761 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-cd4c7692-4566-4893-a72a-ab04276f5989 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1922932 May 25 15:42:22.488051 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-9285d4ad-c727-4613-8e77-fbcecd28d65f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/quotas/fe662b5dcc2c4a1da1aa9473bd7e9dd7 HTTP/1.1" status: 200 len: 375 time: 0.0396810 May 25 15:42:22.515438 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31678097-284a-4560-b901-f6cb1cb011b8 None None] New status for floating IP e0e23f1b-e60a-4257-881a-d0c6cf4e4300: ACTIVE {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:42:22.622246 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:42:22.660852 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-c4c3f348-97eb-40a5-91fc-6deb8d5899ec service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2030625 May 25 15:42:22.685059 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-2220c3a1-e22a-4c34-a4f6-c56b7314ec2e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1955235 May 25 15:42:22.952747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:22.958168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.962767 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:22.977485 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:22.978432 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:42:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:23.035615 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-33745a36-7700-4822-adfa-b13e104e991f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "PUT /v2.0/floatingips/01b3f2a3-f643-46f9-b308-8bf7a8b4f106 HTTP/1.1" status: 200 len: 992 time: 1.8943667 May 25 15:42:23.035615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:23.043577 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-8de388fc-a978-4715-aee4-97b3b8f010ed service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3469648 May 25 15:42:23.049427 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb139f4-7007-4bd5-9068-1b74cd5a84eb req-06b49d9b-2f10-49ff-875f-2f4447a0fd57 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3327816 May 25 15:42:23.143083 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0074f9-bfd8-431f-874d-95c689b5fe14 req-8f08d48d-8ccd-485c-adc4-71370bf60753 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:23.144672 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3b0074f9-bfd8-431f-874d-95c689b5fe14 req-8f08d48d-8ccd-485c-adc4-71370bf60753 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.3375905 May 25 15:42:23.184643 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:23.224218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3b0074f9-bfd8-431f-874d-95c689b5fe14 req-2cac7dd9-91bc-417f-ac83-d2bcd3f8fd5d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720711 May 25 15:42:23.228284 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-092069ad-7031-488c-bfc4-1f7c35cda70e service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1772981 May 25 15:42:23.413145 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'status': 'completed', 'code': 200} May 25 15:42:23.577053 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-98f8ead8-b3c9-4b9e-be2b-8f5b46e702f0 req-031ed47d-926a-405b-99a4-56ef5acd6104 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 210 time: 0.0761952 May 25 15:42:23.695516 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '01b3f2a3-f643-46f9-b308-8bf7a8b4f106', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.232', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:9d:86:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:47Z', 'updated_at': '2021-05-25T15:42:21Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:23.703825 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:23.722627 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:23.723517 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:42:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:23.749683 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-057f8d1a-a514-4e0d-97b1-850a91950f4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:23.751200 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-057f8d1a-a514-4e0d-97b1-850a91950f4c service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1099 time: 0.1708782 May 25 15:42:23.945762 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:24.087983 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-676a6000-6c3f-4a63-99d6-ca0b1ada5363 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.090225 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-676a6000-6c3f-4a63-99d6-ca0b1ada5363 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.1027765 May 25 15:42:24.119572 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-799e0136-cabd-4377-be2f-4b476d8faa3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.121021 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-799e0136-cabd-4377-be2f-4b476d8faa3f service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.2886565 May 25 15:42:24.137865 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2b7ff2-22b0-479b-b9ac-5efbc8d62f0a req-7e9faf8f-18b9-4ee2-a048-49265d0ffb8d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.144888 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ba2b7ff2-22b0-479b-b9ac-5efbc8d62f0a req-7e9faf8f-18b9-4ee2-a048-49265d0ffb8d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2862213 May 25 15:42:24.285302 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ba2b7ff2-22b0-479b-b9ac-5efbc8d62f0a req-1a19b9a9-ae2d-42c5-b721-4d791eb97533 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395364 May 25 15:42:24.299751 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-bf239626-3242-41da-9ddd-97dcf5aa64a3 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 1000 time: 0.1413317 May 25 15:42:24.313255 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-a193c48b-f913-403e-a3a1-c6aa48458ff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.314699 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-a193c48b-f913-403e-a3a1-c6aa48458ff7 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.2051680 May 25 15:42:24.403145 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '01b3f2a3-f643-46f9-b308-8bf7a8b4f106', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.232', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:9d:86:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:47Z', 'updated_at': '2021-05-25T15:42:21Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:24.408713 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b2b745-63a6-4cf5-8524-66cdcacedba8 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '01b3f2a3-f643-46f9-b308-8bf7a8b4f106', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.232', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:9d:86:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:41:47Z', 'updated_at': '2021-05-25T15:42:21Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:24.500054 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-7803c179-38be-4cd7-95ec-d7037c4853c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.502605 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-7803c179-38be-4cd7-95ec-d7037c4853c1 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.1329753 May 25 15:42:24.515156 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-5b8c317b-fbb6-4219-8c99-02118e3fc7ed service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.1496730 May 25 15:42:24.646630 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-ecb3b7ff-1520-4fbd-a589-bfeb9b3995d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.649230 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-ecb3b7ff-1520-4fbd-a589-bfeb9b3995d6 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0902503 May 25 15:42:24.659346 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-35c422dd-5e96-4679-ba4c-3f430eb99c7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.661059 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-35c422dd-5e96-4679-ba4c-3f430eb99c7f service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1114829 May 25 15:42:24.715256 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc00c48b-aedb-49c7-a3e8-4e3b2657b4e0 None None] New status for floating IP 01b3f2a3-f643-46f9-b308-8bf7a8b4f106: ACTIVE {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:42:24.743004 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-06f5ee0b-6ee3-4cd5-be9c-51334630d668 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478716 May 25 15:42:24.791241 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-109a3f03-091b-4d9c-baa8-701a209f9e52 req-50560db0-4a76-46c9-a15e-1aa34a158796 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 210 time: 0.0691864 May 25 15:42:24.917034 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-725accb0-5b3a-4e8c-9744-a5df83507044 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1620967 May 25 15:42:24.990253 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-128de8d4-f4fa-492e-8ff6-da579e0965d1 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1507525 May 25 15:42:25.076884 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a7c75bb-95a8-4ba8-bc72-4c4332049046 req-d8661773-dbc5-4b17-931b-8af9367d5b20 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1456997 May 25 15:42:25.152822 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-dd3ce31d-dd26-430f-a01f-810af27ab450 req-a4f9ee2e-c405-4390-81a4-5bdee18a699b service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1389997 May 25 15:42:25.475415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6b0fac-8180-4a28-a714-be8388195557 req-e89ba124-ddb2-47e7-bf1d-ed8951a48bcd tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:25.476873 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4e6b0fac-8180-4a28-a714-be8388195557 req-e89ba124-ddb2-47e7-bf1d-ed8951a48bcd tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0784140 May 25 15:42:25.520344 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4e6b0fac-8180-4a28-a714-be8388195557 req-41aae12b-df5d-46ab-a13f-2c6ab3a6ac9f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378582 May 25 15:42:25.949092 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b90b979-7765-484a-98ab-011159ae0f22 req-6aa29744-b69f-40c5-a796-d4f5029b7315 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 210 time: 0.0501873 May 25 15:42:26.350597 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-e21b7658-f973-46b0-8f78-5f65f355519e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:26.351871 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-e21b7658-f973-46b0-8f78-5f65f355519e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1447983 May 25 15:42:26.410636 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Request body: {'port': {'device_id': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'admin_state_up': True, 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:26.547733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:26.557672 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:26.567824 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:26.571325 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.720587 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15fef06-30cc-46b2-8b24-b121c747b79f req-772e69f4-feb3-4149-ab5b-9dccd09ae2bd tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:26.722258 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b15fef06-30cc-46b2-8b24-b121c747b79f req-772e69f4-feb3-4149-ab5b-9dccd09ae2bd tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0877426 May 25 15:42:26.779862 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Allocated IP 172.20.0.13 (956d5f61-ae8e-4c95-bd97-6ae439ceff67/bf87cdb0-06e4-4ee0-ad97-e62e40212515/d47929d4-f018-4b59-9ec6-ff3f8d1e44c5) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:26.782361 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b15fef06-30cc-46b2-8b24-b121c747b79f req-971a9b2e-be9a-458d-a054-3479d6ab3817 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545073 May 25 15:42:27.013834 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.055019 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.069884 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.153516 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:27.219767 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2873ca3-d3a8-40c8-a939-48d89e6253bb req-e3574d59-339f-445b-a7d8-42b4a62ef971 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:27.223407 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b2873ca3-d3a8-40c8-a939-48d89e6253bb req-e3574d59-339f-445b-a7d8-42b4a62ef971 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 932 time: 0.1469514 May 25 15:42:27.233915 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:27.239524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:27.244334 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:27.306341 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b2873ca3-d3a8-40c8-a939-48d89e6253bb req-f14a4a50-a2ed-4b4e-8983-e14bc2a80b1a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770857 May 25 15:42:27.319712 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event updated for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:27.331838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.331838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.331838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.331838 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.332402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.332500 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.332818 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.333169 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.333557 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.333912 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.334292 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.334664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:27.340295 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.347114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:27.347787 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.378479 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9715686 May 25 15:42:27.467815 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Request body: {'port': {'device_id': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:27.606718 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.985826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:27.992930 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c008a7e7-6d0d-4e60-833c-270988c4ecf2 req-6f368815-ea98-4b1b-b799-c26e650581cf tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:27.993447 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.994394 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c008a7e7-6d0d-4e60-833c-270988c4ecf2 req-6f368815-ea98-4b1b-b799-c26e650581cf tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0980887 May 25 15:42:28.007323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Transition to ACTIVE for port object d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:28.012112 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.017003 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.040758 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c008a7e7-6d0d-4e60-833c-270988c4ecf2 req-f71fbb49-b62e-4c78-8fae-1f91f7c47798 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405343 May 25 15:42:28.195062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Pushing event updated for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:28.200498 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.240625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Attempting to bind port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:28.240961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Attempting to bind port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:28.241288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Attempting to bind port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:28.245796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:28.246114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Attempting to bind port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:28.251654 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:28.252008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Checking segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:28.252370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Bound using segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:28.252797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Bound port: d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:28.253138 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.339634 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:28.342669 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:28.346870 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.351508 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-be87b41e-80e8-4aa9-957b-b8c45a3afeb1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.410891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.411490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.412878 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] 10.222.0.74 "PUT /v2.0/ports/d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 200 len: 1094 time: 0.9510040 May 25 15:42:28.413359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:28.435786 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Pushing event updated for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:28.438800 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.459873 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'status': 'completed', 'code': 200} May 25 15:42:28.503103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c99c7f-d2cf-45cc-b082-5a6896753fb6 req-d6fb84e6-e583-4323-91e7-1291f1963b95 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.504828 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e8c99c7f-d2cf-45cc-b082-5a6896753fb6 req-d6fb84e6-e583-4323-91e7-1291f1963b95 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.0909369 May 25 15:42:28.552624 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e8c99c7f-d2cf-45cc-b082-5a6896753fb6 req-ad9c7f40-5e94-4c02-8cbf-bfe9fc41bae3 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417616 May 25 15:42:28.707079 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-6be1c4f8-dc9e-4959-b8b8-3ff90524c77b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.708605 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-6be1c4f8-dc9e-4959-b8b8-3ff90524c77b service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1097 time: 0.0709019 May 25 15:42:28.872860 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-85d8ea99-f787-485c-ab99-58d44ae982bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.874279 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-85d8ea99-f787-485c-ab99-58d44ae982bb service neutron] 10.222.0.74 "GET /v2.0/networks?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1333704 May 25 15:42:29.026988 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-00739867-3685-4e3c-bc1e-73a5592b2369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.028973 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2e6bcde1-68dc-40fc-853b-fbd21f492889 req-00739867-3685-4e3c-bc1e-73a5592b2369 service neutron] 10.222.0.74 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1346056 May 25 15:42:29.098220 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1b187bf7-3e5b-4f62-88a5-bcb10f250534 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.231965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99e31d3-291f-408a-83d5-9b92bff41ddd req-b95c2965-05a1-4497-a3e8-4d6948c10c43 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.233374 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b99e31d3-291f-408a-83d5-9b92bff41ddd req-b95c2965-05a1-4497-a3e8-4d6948c10c43 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0852854 May 25 15:42:29.278864 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b99e31d3-291f-408a-83d5-9b92bff41ddd req-64e32206-cb80-4f57-98ed-9d031abce5b0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396800 May 25 15:42:29.329235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-ba5a974c-eee2-4fcf-b191-e7754a749cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.330949 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-ba5a974c-eee2-4fcf-b191-e7754a749cd6 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1097 time: 0.0712535 May 25 15:42:29.431424 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-90201c4f-9cbb-407d-bfaf-38a57da2a25d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 200 len: 217 time: 0.0636144 May 25 15:42:29.509072 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19caeba-b668-4395-84e6-0c36e319129c req-110be7d3-9c64-4e57-b1ea-1714939b27ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.510395 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-110be7d3-9c64-4e57-b1ea-1714939b27ee service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0589633 May 25 15:42:29.662255 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-7ccefe7d-512b-4363-a060-e036c373d6f8 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1276624 May 25 15:42:29.809889 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb8ba1a-1bb8-414f-b81a-9d5c9fcdab5b req-20d91e4f-07fb-4d49-86b6-66cb1efe2af6 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.818502 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ebb8ba1a-1bb8-414f-b81a-9d5c9fcdab5b req-20d91e4f-07fb-4d49-86b6-66cb1efe2af6 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.1328840 May 25 15:42:29.879066 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-04c68fd5-5e96-4045-b7d1-12925afd56eb service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2017088 May 25 15:42:29.879881 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ebb8ba1a-1bb8-414f-b81a-9d5c9fcdab5b req-af5e701b-3ce6-4b23-83b7-6b9dee12a3c9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568469 May 25 15:42:30.122369 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55810) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:30.135209 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e19caeba-b668-4395-84e6-0c36e319129c req-a5789edd-21e3-470a-97d5-944b730c20cd service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1535926 May 25 15:42:30.279783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.298330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:30.307858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Usage tracker for resource:security_group_rule and tenant:54104e1526254444bad83077617e8842 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:30.307858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:30.313519 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:30.478180 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.486102 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.499372 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:30.561077 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=54104e1526254444bad83077617e8842&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4367204 May 25 15:42:30.561951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55826) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:30.562439 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8723f71-8d37-4df0-8f24-e8cecb91505e,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:30.573719 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.574074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.574435 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.575412 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.575767 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.576123 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.576465 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.576808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.577150 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.577604 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.577951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.578290 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:30.583371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.605455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64985f2c-65a7-4a65-91f5-4150ef72169a req-7fb8da51-2446-4d81-9aea-d28201550ebf tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:30.606951 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-64985f2c-65a7-4a65-91f5-4150ef72169a req-7fb8da51-2446-4d81-9aea-d28201550ebf tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1734600 May 25 15:42:30.638434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.672604 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-64985f2c-65a7-4a65-91f5-4150ef72169a req-d5ec9d6b-f7d4-441f-bd83-83ba38e91ce3 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573037 May 25 15:42:30.687409 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.754535 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.758370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e9d08bab-8e1c-437c-856a-6b5a5e6ef12e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:30.774345 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8723f71-8d37-4df0-8f24-e8cecb91505e,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:30.780750 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.781538 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.782620 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e8723f71-8d37-4df0-8f24-e8cecb91505e HTTP/1.1" status: 204 len: 168 time: 0.2196620 May 25 15:42:31.071329 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55840) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:31.089711 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.104971 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:31.108723 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Usage tracker for resource:security_group_rule and tenant:4f021a6554b94b2fbffadc2065909a7d is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:31.111451 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:31.117132 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:31.125230 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204a6b30-8128-441a-a86f-dd453fe2c18c req-d7eee349-c7b7-49f0-b246-c5037d3455f1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:31.126916 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-204a6b30-8128-441a-a86f-dd453fe2c18c req-d7eee349-c7b7-49f0-b246-c5037d3455f1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.1441226 May 25 15:42:31.174444 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-204a6b30-8128-441a-a86f-dd453fe2c18c req-6e8656b4-2d57-4eb7-a4de-29acfa479e25 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414202 May 25 15:42:31.200507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.205132 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.213925 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.253797 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4f021a6554b94b2fbffadc2065909a7d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1812847 May 25 15:42:31.255474 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2ba0ad0-d688-4465-bfe3-2a5d2e176148,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:31.256402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55846) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:31.258803 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.315097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.340873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.392591 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.397361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4a2e19e8-57f0-48c6-b03c-9be7ba5137e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.409207 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2ba0ad0-d688-4465-bfe3-2a5d2e176148,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:31.412642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.418229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.419391 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/a2ba0ad0-d688-4465-bfe3-2a5d2e176148 HTTP/1.1" status: 204 len: 168 time: 0.1617775 May 25 15:42:31.498985 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.683801 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8f02e23f-d3f1-48f1-a3c0-c2f70e897631 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.785503 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55862) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:31.804430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.818826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:31.822531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Usage tracker for resource:security_group_rule and tenant:664721c9183c4be4894ce8ff2cba3f4f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:31.825354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:31.831175 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:31.870975 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842e111d-adc0-4b1f-8da9-010244b57dca req-0c9c418a-60d1-4c79-8318-baa9ad94eeb1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:31.873123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-842e111d-adc0-4b1f-8da9-010244b57dca req-0c9c418a-60d1-4c79-8318-baa9ad94eeb1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0841999 May 25 15:42:31.923430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.926218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-842e111d-adc0-4b1f-8da9-010244b57dca req-9b701a3a-9d35-4e8a-b217-ba7d16120f94 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474963 May 25 15:42:31.928194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.941781 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.983685 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=664721c9183c4be4894ce8ff2cba3f4f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1969368 May 25 15:42:31.985265 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26569d3a-bcf5-4fb3-ae74-c2774883d109,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:31.986529 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55868) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:31.992539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.044843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.069113 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.124033 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.127416 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:32.137805 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26569d3a-bcf5-4fb3-ae74-c2774883d109,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:32.142527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.144447 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.145534 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/26569d3a-bcf5-4fb3-ae74-c2774883d109 HTTP/1.1" status: 204 len: 168 time: 0.1580086 May 25 15:42:32.362960 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2aea373-0c96-45ab-8e4f-c19226279491 req-a2b892a5-e8d7-422b-84ef-5dddc47eca37 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:32.364444 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c2aea373-0c96-45ab-8e4f-c19226279491 req-a2b892a5-e8d7-422b-84ef-5dddc47eca37 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.0798810 May 25 15:42:32.413142 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c2aea373-0c96-45ab-8e4f-c19226279491 req-832a7b3f-53c0-40de-a244-2a922580cd12 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429919 May 25 15:42:32.662199 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.923436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55908) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:33.053769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-912694672-network', 'tenant_id': 'ac7ba677968248629edb2c52ffcbaf6b'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:33.058320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:33.062234 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Usage tracker for resource:network and tenant:ac7ba677968248629edb2c52ffcbaf6b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:33.064987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:33.070911 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:33.080574 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Made reservation on behalf of ac7ba677968248629edb2c52ffcbaf6b for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:33.082909 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.094814 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.111322 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:33.114944 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Usage tracker for resource:security_group_rule and tenant:ac7ba677968248629edb2c52ffcbaf6b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:33.117661 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:33.123100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:33.204034 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.207710 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.210465 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-02c625b2-09f6-49bb-9f8a-6ea301601ff6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:33.237035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] vlan segment allocate from pool success with {'vlan_id': 837, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:33.245061 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76fee170-46c4-4984-b18d-a602291af03e,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:33.248444 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:33.250769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.251078 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Added segment 01e89f68-a28a-4109-a6b7-004659c4f358 of type vlan for network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd May 25 15:42:33.276036 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.303533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.304816 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:33.305378 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.309802 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-44caf503-4f3d-4fab-b538-c3ec1e6024ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:33.404684 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4801161 May 25 15:42:33.405563 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Pushing event updated for resources: {'Network': ['ID=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:33.407461 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55918) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:33.409735 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:33.413375 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Request body: {'subnet': {'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-912694672-subnet', 'tenant_id': 'ac7ba677968248629edb2c52ffcbaf6b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:33.415664 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:33.417896 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:33.421737 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Usage tracker for resource:subnet and tenant:ac7ba677968248629edb2c52ffcbaf6b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:33.424643 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:33.430377 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:33.441970 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Made reservation on behalf of ac7ba677968248629edb2c52ffcbaf6b for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:33.447934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3745239'] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.835014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3356678', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3745217'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.839464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a9d30e7d-8e2e-49bc-afc3-27eac65600f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:33.907254 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8359c6d8-0d8a-4f13-a065-36bfd3350e4a,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:33.909893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:33.915681 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Checking segment: {'id': '01e89f68-a28a-4109-a6b7-004659c4f358', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:33.916134 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Network hostable DHCP agents. Network: bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:33.932804 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:33.942129 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:33.950502 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:33.950955 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac6d86d0-529c-441e-ba7c-e7fa74aa843a None None] Network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:33.951359 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.972664 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-67c495b4-0ece-4319-984e-7718a1942bc2 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.5641432 May 25 15:42:34.155917 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b84c4dc0-1a09-487f-975e-525723e1747c None None] Network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:34.351497 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.371267 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.056091 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-133a9b28-26f2-4fcb-89cf-7ade3c244979 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0677562 May 25 15:42:37.361417 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550acf7f-f91e-4355-b56e-4269a7830cd0 req-4481a662-f153-4a62-87ba-6c9358a8fc42 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.363205 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-550acf7f-f91e-4355-b56e-4269a7830cd0 req-4481a662-f153-4a62-87ba-6c9358a8fc42 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0968926 May 25 15:42:37.392117 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-2bfffbe6-70b6-4774-a11d-ed0082a4c12e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.393396 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-2bfffbe6-70b6-4774-a11d-ed0082a4c12e service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0891685 May 25 15:42:37.466611 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-550acf7f-f91e-4355-b56e-4269a7830cd0 req-933958c8-49e8-48ff-848b-36ef256f846c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971210 May 25 15:42:37.491725 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fba4470-2136-4bb2-9fb2-e320cc62f0dd req-d04972c4-e09d-425e-abe7-5f1eccfda899 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.492871 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3fba4470-2136-4bb2-9fb2-e320cc62f0dd req-d04972c4-e09d-425e-abe7-5f1eccfda899 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.1088815 May 25 15:42:37.538047 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3fba4470-2136-4bb2-9fb2-e320cc62f0dd req-7a8d8795-05f5-4420-9e94-844534731cb9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391562 May 25 15:42:37.595519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-85cf1784-4226-4eab-b3ba-c4664f1ecfbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.596955 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-85cf1784-4226-4eab-b3ba-c4664f1ecfbc service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1483631 May 25 15:42:37.682386 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-8360381d-26fb-4e8c-9098-1e75a0978fd4 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0586514 May 25 15:42:37.763374 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-4b2cb4a0-5784-4642-ad46-18d95748da96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.764760 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-4b2cb4a0-5784-4642-ad46-18d95748da96 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0588036 May 25 15:42:37.818690 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-5b329844-8d27-4e15-ae62-0c87ff2f4e96 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0392253 May 25 15:42:37.960371 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-d24e3e6c-e0b2-4549-adff-46816d533195 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1312935 May 25 15:42:38.094125 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2c47097a-5e72-4d7b-a75a-eded1fbb828e req-d5deef13-968e-420a-a703-983eea62e3ad service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1189251 May 25 15:42:38.702695 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d5ca09-cfaf-4156-a004-e0c2cf104819 req-6a1ffaa7-fc8b-4ad8-84a8-2b965c2617d8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.704136 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-41d5ca09-cfaf-4156-a004-e0c2cf104819 req-6a1ffaa7-fc8b-4ad8-84a8-2b965c2617d8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0849938 May 25 15:42:38.797516 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-41d5ca09-cfaf-4156-a004-e0c2cf104819 req-7184a4f0-e577-470e-9d5e-b2a7eec35d91 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619054 May 25 15:42:38.816099 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b5a803-95c1-4a65-a794-986ffd4a2f4d req-e1c8f8a5-c0ff-44ab-8daa-f714f1a8c20e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.817500 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f4b5a803-95c1-4a65-a794-986ffd4a2f4d req-e1c8f8a5-c0ff-44ab-8daa-f714f1a8c20e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 944 time: 0.1120605 May 25 15:42:38.860996 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f4b5a803-95c1-4a65-a794-986ffd4a2f4d req-a8d96715-e529-47cb-be0f-9adfd82527ff tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379291 May 25 15:42:39.222026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:39.352774 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:39.365328 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'port_id': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'mac_address': 'fa:16:3e:da:c6:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 836, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf87cdb0-06e4-4ee0-ad97-e62e40212515', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:39.380454 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55177801-b5fd-48fe-bc7a-a67020463906 req-3bce2071-feb8-4e1c-b27f-836d312067bc tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:39.381914 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-55177801-b5fd-48fe-bc7a-a67020463906 req-3bce2071-feb8-4e1c-b27f-836d312067bc tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.0781701 May 25 15:42:39.419508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.427856 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-55177801-b5fd-48fe-bc7a-a67020463906 req-613f3b43-fbc5-479f-aab9-fbdb52f6724f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392358 May 25 15:42:39.437739 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:39.454191 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:39.458146 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.459828 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.527348 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:39.534754 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.535118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.535460 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.535846 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.536113 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.536445 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.536777 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.537103 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.537450 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.537776 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.538110 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.538421 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:39.552468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.176158 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ccff143-fc1d-4397-b561-cddda8d4deef req-f4209953-f8f9-4e28-aa5f-1448c9f7a509 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.177592 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1ccff143-fc1d-4397-b561-cddda8d4deef req-f4209953-f8f9-4e28-aa5f-1448c9f7a509 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 945 time: 0.1046214 May 25 15:42:40.189787 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11cf911-fbb1-4f04-a154-627b15a91abb req-8831ce9b-c0a0-45a2-ba29-d156fc0c48d2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.191288 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a11cf911-fbb1-4f04-a154-627b15a91abb req-8831ce9b-c0a0-45a2-ba29-d156fc0c48d2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2187312 May 25 15:42:40.256835 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1ccff143-fc1d-4397-b561-cddda8d4deef req-50e0dfac-9158-4be3-bef5-2419c104e2ff tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645874 May 25 15:42:40.266475 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a11cf911-fbb1-4f04-a154-627b15a91abb req-81e73b92-eb93-426e-bb69-97c9a746a3d1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600147 May 25 15:42:40.379506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['d47929d4-f018-4b59-9ec6-ff3f8d1e44c5'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:40.525571 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-5dd315a0-cd58-4f8b-af7f-94276fec8c19 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.526331 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-5dd315a0-cd58-4f8b-af7f-94276fec8c19 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Synchronizing usage tracker for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:40.545268 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-5dd315a0-cd58-4f8b-af7f-94276fec8c19 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Unset dirty status for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:40.546543 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-5dd315a0-cd58-4f8b-af7f-94276fec8c19 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/networks?id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd HTTP/1.1" status: 200 len: 813 time: 0.1945646 May 25 15:42:40.597441 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-65b55820-208a-461a-b28f-496eb6b28787 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/quotas/ac7ba677968248629edb2c52ffcbaf6b HTTP/1.1" status: 200 len: 375 time: 0.0451963 May 25 15:42:40.658100 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-b2bfee53-63b5-441f-81df-6f324cedd92e tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=ac7ba677968248629edb2c52ffcbaf6b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0502453 May 25 15:42:40.762841 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1550d8d2-9b44-4ec1-a727-3fd3beb47120 req-d88f69cf-4c6f-450a-8737-38bfda7af74b tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.764360 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1550d8d2-9b44-4ec1-a727-3fd3beb47120 req-d88f69cf-4c6f-450a-8737-38bfda7af74b tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.2110305 May 25 15:42:40.833728 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-c1a7d3e7-b9a6-4eae-bfec-10f30d47ee30 service neutron] 10.222.0.25 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1690159 May 25 15:42:40.838194 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1550d8d2-9b44-4ec1-a727-3fd3beb47120 req-c7a4f068-405a-4452-be96-4adc6a69cf05 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673194 May 25 15:42:40.963646 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-ad816a58-aaf1-4c92-806b-7aff107b2276 service neutron] 10.222.0.25 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238177 May 25 15:42:41.170797 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1c3f434d-d506-4bc0-9382-d1c117eb37d6 req-6a33ba15-5854-4823-8203-9ef299cab48f tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0424101 May 25 15:42:41.511057 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d138b6c5-9af6-4d24-9382-524ae2ca0068 req-3d103945-c5b9-4ae4-b30d-3170810b2090 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:41.512571 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d138b6c5-9af6-4d24-9382-524ae2ca0068 req-3d103945-c5b9-4ae4-b30d-3170810b2090 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 945 time: 0.1436083 May 25 15:42:41.520169 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2705a396-bc01-4a73-99a2-3e8ec3ee3126 req-3e107428-68d2-44aa-8c1e-365442ce9840 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:41.521536 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2705a396-bc01-4a73-99a2-3e8ec3ee3126 req-3e107428-68d2-44aa-8c1e-365442ce9840 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1185572 May 25 15:42:41.599600 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d138b6c5-9af6-4d24-9382-524ae2ca0068 req-ae09db99-6ec1-4eaa-b8ea-cfaca5b5f8f1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727091 May 25 15:42:41.599600 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2705a396-bc01-4a73-99a2-3e8ec3ee3126 req-1c0c04c2-90a3-4016-8eb1-62abd152eeac tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641518 May 25 15:42:42.022989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae64e415-153a-4d1e-8884-069a991ce59a req-bb378796-d76b-430c-80c2-d92efeb3b097 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.024461 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ae64e415-153a-4d1e-8884-069a991ce59a req-bb378796-d76b-430c-80c2-d92efeb3b097 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.0773759 May 25 15:42:42.067687 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ae64e415-153a-4d1e-8884-069a991ce59a req-efb7993d-272b-4920-897e-7f0efb55c2bd tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370271 May 25 15:42:42.318226 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a37e5665-33fd-4af1-8c82-4a1e5a8267c3 req-f8349522-de9e-45f0-a483-45c200fc8b8a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0448718 May 25 15:42:42.424067 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:42:42.852045 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ac42da-31a9-461d-82bb-3bfb6ff09cf0 req-82df8259-3070-46ee-a02e-764b586d0673 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.853478 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b3ac42da-31a9-461d-82bb-3bfb6ff09cf0 req-82df8259-3070-46ee-a02e-764b586d0673 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 945 time: 0.1456358 May 25 15:42:42.864939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac198505-51e5-47d9-9d7c-0ee6d5176b93 req-4b1347b5-2b11-449b-911d-0d9e8d379b15 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.866336 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ac198505-51e5-47d9-9d7c-0ee6d5176b93 req-4b1347b5-2b11-449b-911d-0d9e8d379b15 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1271780 May 25 15:42:42.934666 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b3ac42da-31a9-461d-82bb-3bfb6ff09cf0 req-445bd8c3-ca48-47a0-9934-55a80cb063ce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668483 May 25 15:42:42.941318 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ac198505-51e5-47d9-9d7c-0ee6d5176b93 req-6f673c38-d994-4e96-9693-018596113380 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605946 May 25 15:42:43.097628 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-3c46b6fc-7098-4b2c-b801-d19b2fa79b30 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:43.099290 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-3c46b6fc-7098-4b2c-b801-d19b2fa79b30 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.74 "GET /v2.0/networks?id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd HTTP/1.1" status: 200 len: 813 time: 0.1527729 May 25 15:42:43.145658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Request body: {'port': {'device_id': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd', 'admin_state_up': True, 'tenant_id': 'ac7ba677968248629edb2c52ffcbaf6b'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:43.218713 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:43.257071 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe831c0-186c-4b8f-9c7d-971d1ad81f8b req-63ddbd10-8745-4b9f-a084-17b710345b27 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:43.258631 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2fe831c0-186c-4b8f-9c7d-971d1ad81f8b req-63ddbd10-8745-4b9f-a084-17b710345b27 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.0837345 May 25 15:42:43.312581 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2fe831c0-186c-4b8f-9c7d-971d1ad81f8b req-d3e01073-2aa2-475a-b9d7-6f8f801fd52c tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477023 May 25 15:42:43.332372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:43.336870 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:43.337251 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.412263 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:43.416359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Usage tracker for resource:port and tenant:ac7ba677968248629edb2c52ffcbaf6b is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:43.426042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:43.432263 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:43.444209 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Made reservation on behalf of ac7ba677968248629edb2c52ffcbaf6b for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:43.448607 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.475259 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-23ae5f40-88a3-4482-a952-0cad7b2a9ef0 req-6dcac003-0f12-4ca1-890c-50b90a6b8f40 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0483994 May 25 15:42:43.482208 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.509347 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:43.519172 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:43.523844 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.525851 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.578028 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'code': 200} May 25 15:42:43.601428 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:43.604654 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.655691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Allocated IP 172.20.0.5 (bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd/8359c6d8-0d8a-4f13-a065-36bfd3350e4a/73cac064-2d02-401c-bb22-890fdda0d24a) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:43.865267 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.895032 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.901514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.975570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:43.978277 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:43.982912 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:44.016933 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Pushing event updated for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:44.025183 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.089563 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.091184 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:44.133631 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9917862 May 25 15:42:44.158867 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e7063b-7399-45fa-8f10-9119f07e5b40 req-72815206-f80a-43c3-8d58-2ba7bc8b3b16 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.167489 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e7e7063b-7399-45fa-8f10-9119f07e5b40 req-72815206-f80a-43c3-8d58-2ba7bc8b3b16 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.1037638 May 25 15:42:44.184542 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Request body: {'port': {'device_id': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:44.339386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:44.354391 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e7e7063b-7399-45fa-8f10-9119f07e5b40 req-4fc3b6ad-089c-49e9-9931-f65849b789d5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1847899 May 25 15:42:44.453427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a05371-5cdc-4f9c-9fff-e579c887117b req-da8da4a7-99d4-4c4f-9277-a1ebb59b7001 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.460369 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-87a05371-5cdc-4f9c-9fff-e579c887117b req-da8da4a7-99d4-4c4f-9277-a1ebb59b7001 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2738028 May 25 15:42:44.562814 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3062bdc2-7142-4f89-8b65-d77c7ae9d106 req-0187150a-205a-4184-8618-388610ba2844 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.564449 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3062bdc2-7142-4f89-8b65-d77c7ae9d106 req-0187150a-205a-4184-8618-388610ba2844 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1099 time: 0.1994188 May 25 15:42:44.575326 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-87a05371-5cdc-4f9c-9fff-e579c887117b req-926e1624-7699-47b9-a264-0f0274a4a04a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137338 May 25 15:42:44.640400 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5efe98f-6782-4653-bff2-3752e68de8ae req-de7ce622-16a0-4a90-b3d2-a50c0931c645 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.641870 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b5efe98f-6782-4653-bff2-3752e68de8ae req-de7ce622-16a0-4a90-b3d2-a50c0931c645 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.1777315 May 25 15:42:44.647609 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3062bdc2-7142-4f89-8b65-d77c7ae9d106 req-1b32229a-ca72-4dd9-b000-611e1a0a4d5c service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630314 May 25 15:42:44.743150 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b5efe98f-6782-4653-bff2-3752e68de8ae req-7a4ef719-8022-4af2-8a7c-7f6d46896797 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875621 May 25 15:42:44.752332 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 73cac064-2d02-401c-bb22-890fdda0d24a {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:44.763791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:44.781489 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Transition to ACTIVE for port object 73cac064-2d02-401c-bb22-890fdda0d24a will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:44.785614 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:44.788171 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fd6f91f-8cee-44b6-acac-2c66e885cb4a req-9d32eaff-4722-43e9-a1b6-14f7f23f568d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.789767 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.789902 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7fd6f91f-8cee-44b6-acac-2c66e885cb4a req-9d32eaff-4722-43e9-a1b6-14f7f23f568d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 931 time: 0.0992661 May 25 15:42:44.838310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-7fd6f91f-8cee-44b6-acac-2c66e885cb4a req-149755b0-9757-4e94-8fa3-8860b68a8569 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Synchronizing usage tracker for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:44.858256 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-7fd6f91f-8cee-44b6-acac-2c66e885cb4a req-149755b0-9757-4e94-8fa3-8860b68a8569 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Unset dirty status for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:44.859649 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7fd6f91f-8cee-44b6-acac-2c66e885cb4a req-149755b0-9757-4e94-8fa3-8860b68a8569 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636368 May 25 15:42:44.868363 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Pushing event updated for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:44.918062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.045922 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Attempting to bind port 73cac064-2d02-401c-bb22-890fdda0d24a on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:45.046268 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Attempting to bind port 73cac064-2d02-401c-bb22-890fdda0d24a by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '01e89f68-a28a-4109-a6b7-004659c4f358', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:45.046600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Attempting to bind port 73cac064-2d02-401c-bb22-890fdda0d24a on network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:45.051933 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Port 73cac064-2d02-401c-bb22-890fdda0d24a on network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:45.052256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Attempting to bind port 73cac064-2d02-401c-bb22-890fdda0d24a on network bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:45.057657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:45.057987 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Checking segment: {'id': '01e89f68-a28a-4109-a6b7-004659c4f358', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:45.058366 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Bound using segment: {'id': '01e89f68-a28a-4109-a6b7-004659c4f358', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:45.058832 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Bound port: 73cac064-2d02-401c-bb22-890fdda0d24a, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01e89f68-a28a-4109-a6b7-004659c4f358', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:45.059394 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:45.151318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:45.155437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73cac064-2d02-401c-bb22-890fdda0d24a,segment=NetworkSegment(01e89f68-a28a-4109-a6b7-004659c4f358),segment_id=01e89f68-a28a-4109-a6b7-004659c4f358)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:45.159957 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:45.163573 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a4b53f65-8617-4120-9737-fff59364a9b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.226074 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.226683 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:45.228053 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] 10.222.0.74 "PUT /v2.0/ports/73cac064-2d02-401c-bb22-890fdda0d24a HTTP/1.1" status: 200 len: 1093 time: 1.0489917 May 25 15:42:45.228527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:45.243897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Pushing event updated for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:45.246671 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.503217 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-23884204-d015-4b64-a725-9a2c0484f1be tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.504854 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-23884204-d015-4b64-a725-9a2c0484f1be tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.74 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.0885789 May 25 15:42:45.555446 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-43cde487-4d2b-41b4-9d3d-1b41b32de2f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.557009 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-43cde487-4d2b-41b4-9d3d-1b41b32de2f0 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=ac7ba677968248629edb2c52ffcbaf6b&device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 1096 time: 0.0818100 May 25 15:42:45.586312 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a', 'status': 'completed', 'code': 200} May 25 15:42:45.694286 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-9bf7e0c5-ad2f-4bbb-b867-ce33dc479cd0 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=73cac064-2d02-401c-bb22-890fdda0d24a HTTP/1.1" status: 200 len: 217 time: 0.0936768 May 25 15:42:45.775201 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-9edb973b-f6c4-448f-b717-5ea2a747a78c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.776599 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-9edb973b-f6c4-448f-b717-5ea2a747a78c service neutron] 10.222.0.74 "GET /v2.0/subnets?id=8359c6d8-0d8a-4f13-a065-36bfd3350e4a HTTP/1.1" status: 200 len: 853 time: 0.0721107 May 25 15:42:45.893560 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3477edc8-dfe3-4ce2-b298-852278316e0b req-3082beef-cde5-499e-b5db-26d4aa4dc300 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.895070 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3477edc8-dfe3-4ce2-b298-852278316e0b req-3082beef-cde5-499e-b5db-26d4aa4dc300 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.2235427 May 25 15:42:45.909465 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Deleting port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:42:45.910124 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:45.923159 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-61553988-dc6c-4ed8-9e01-7056ef2afb9e service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1333342 May 25 15:42:45.945341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2251b026-bb57-48a4-82ad-231a1cd89434 req-5bc1e220-9a16-4ba1-8670-f18b5159e5e0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.946666 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2251b026-bb57-48a4-82ad-231a1cd89434 req-5bc1e220-9a16-4ba1-8670-f18b5159e5e0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2187555 May 25 15:42:46.093302 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-67779ef8-f328-47af-af1f-556bdb01723a service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1425538 May 25 15:42:46.094745 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3477edc8-dfe3-4ce2-b298-852278316e0b req-282a90d8-e4d4-4c39-8147-607eeb53c516 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1883740 May 25 15:42:46.104518 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2251b026-bb57-48a4-82ad-231a1cd89434 req-13d371fd-7f6d-48ea-b1b1-6b0d0a0c73e8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098971 May 25 15:42:46.191927 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] For port 47cc10ba-9942-4817-9ec9-0b0bdaf65164, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=47cc10ba-9942-4817-9ec9-0b0bdaf65164,segment=NetworkSegment(12684b13-b98f-4241-9d70-842214716852),segment_id=12684b13-b98f-4241-9d70-842214716852)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:46.194691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.344148 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b200e8c0-cf9e-4454-b852-36ce93507fec req-d546ed0a-a955-46bf-bae4-33de0c9ab021 service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2219040 May 25 15:42:46.454143 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56208) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:46.468300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Calling delete_port for 47cc10ba-9942-4817-9ec9-0b0bdaf65164 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:42:46.517378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Deleting subnet b546f21d-4510-446e-9694-4d46efe8a426 {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:42:46.520590 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.616380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.625178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca71de5-5a32-42ba-920e-0cc45f508277 req-ad1f2381-73c9-4343-b5d3-f03e559eaf4d tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.626617 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7ca71de5-5a32-42ba-920e-0cc45f508277 req-ad1f2381-73c9-4343-b5d3-f03e559eaf4d tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 946 time: 0.2896645 May 25 15:42:46.634851 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa28fa9b-0e48-4d38-8472-2b5884f945e5 req-89d1319a-6c5a-4ffa-8380-7b2f5b70caeb tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.636207 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa28fa9b-0e48-4d38-8472-2b5884f945e5 req-89d1319a-6c5a-4ffa-8380-7b2f5b70caeb tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 943 time: 0.2657943 May 25 15:42:46.696763 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.725618 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7ca71de5-5a32-42ba-920e-0cc45f508277 req-048f8676-aa7c-44bb-a316-e80c74609506 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/security-groups?id=b829a5c6-1f8b-4e38-893d-5965279c6b75&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0874770 May 25 15:42:46.728676 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-84d2b280-0964-4f71-84d3-0570812d7457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.730160 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-84d2b280-0964-4f71-84d3-0570812d7457 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=ac7ba677968248629edb2c52ffcbaf6b&device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 1096 time: 0.1691437 May 25 15:42:46.759754 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa28fa9b-0e48-4d38-8472-2b5884f945e5 req-ec3de856-3b99-49b9-a7dc-bdc7a1cd6a36 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063547 May 25 15:42:46.813828 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.826110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.877177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Pushing event deleted for resources: {'Port': ['ID=47cc10ba-9942-4817-9ec9-0b0bdaf65164,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:46.880620 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.026160 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] No DVR routers for this DVR port 47cc10ba-9942-4817-9ec9-0b0bdaf65164 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:42:47.029576 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.032435 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'name': 'network-vif-deleted', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:47.040474 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-01c65cda-5452-4ca3-bf4c-ac4a5abcb4e8 req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.74 "DELETE /v2.0/ports/47cc10ba-9942-4817-9ec9-0b0bdaf65164 HTTP/1.1" status: 204 len: 173 time: 1.4457800 May 25 15:42:47.056086 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-0488323f-a405-45ec-bad7-c243531f484d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.057439 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-0488323f-a405-45ec-bad7-c243531f484d service neutron] 10.222.0.74 "GET /v2.0/networks?id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd HTTP/1.1" status: 200 len: 914 time: 0.3150849 May 25 15:42:47.087755 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.092788 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.130435 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b546f21d-4510-446e-9694-4d46efe8a426,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:47.132490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.135107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.139155 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/b546f21d-4510-446e-9694-4d46efe8a426 HTTP/1.1" status: 204 len: 168 time: 0.6837425 May 25 15:42:47.141697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56232) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:47.257930 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 47cc10ba-9942-4817-9ec9-0b0bdaf65164 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:42:47.276244 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98918df2-2c75-4aad-92a7-cdd2e109424e', 'name': 'network-vif-deleted', 'tag': '47cc10ba-9942-4817-9ec9-0b0bdaf65164', 'status': 'completed', 'code': 200} May 25 15:42:47.284879 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-95c97a88-9bc0-4f05-abcc-9c84b9a3baa8 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=73cac064-2d02-401c-bb22-890fdda0d24a HTTP/1.1" status: 200 len: 217 time: 0.0788045 May 25 15:42:47.303656 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 47cc10ba-9942-4817-9ec9-0b0bdaf65164 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:42:47.304312 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 47cc10ba-9942-4817-9ec9-0b0bdaf65164 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:42:47.306228 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.477226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c1d987-383b-4d61-bfd3-8a3c271b491d req-cb9dcfdf-a004-42bc-9a30-4593b67a7da5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.490127 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c9c1d987-383b-4d61-bfd3-8a3c271b491d req-cb9dcfdf-a004-42bc-9a30-4593b67a7da5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.1246679 May 25 15:42:47.490733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.508432 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c22fd88-c707-4a76-88a0-593fe9b22cc6']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:47.526346 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38748490-d124-4961-b1a8-deb796932972') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:47.526656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38748490-d124-4961-b1a8-deb796932972') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:47.540836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.563462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.575044 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-67cb2db0-9e63-4bd0-8f8a-9b97510ebacb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.576947 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-67cb2db0-9e63-4bd0-8f8a-9b97510ebacb service neutron] 10.222.0.74 "GET /v2.0/subnets?id=8359c6d8-0d8a-4f13-a065-36bfd3350e4a HTTP/1.1" status: 200 len: 853 time: 0.1647921 May 25 15:42:47.578118 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Releasing vlan 841 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:42:47.578523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:42:47.596102 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:42:47.598378 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c9c1d987-383b-4d61-bfd3-8a3c271b491d req-67232cef-5db4-45cb-8750-a0fceedb3413 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071448 May 25 15:42:47.619934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a524de27-6ada-4d7e-a083-ee471ac336e4 req-96ae5227-1365-4c36-982a-961271a59583 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.622080 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a524de27-6ada-4d7e-a083-ee471ac336e4 req-96ae5227-1365-4c36-982a-961271a59583 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1157715 May 25 15:42:47.680525 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a524de27-6ada-4d7e-a083-ee471ac336e4 req-4e479587-afa0-4260-b840-3312acb225a4 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519521 May 25 15:42:47.788513 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-9b22e464-d6a9-4f73-b7a6-9eae60394816 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1879015 May 25 15:42:47.822602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.877334 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.894173 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:47.906986 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Pushing event deleted for resources: {'Network': ['ID=5c22fd88-c707-4a76-88a0-593fe9b22cc6,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:47.911063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.912432 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e3a5f9df-7ffa-47c6-92c0-7205486306cf admin admin] 10.222.0.25 "DELETE /v2.0/networks/5c22fd88-c707-4a76-88a0-593fe9b22cc6 HTTP/1.1" status: 204 len: 168 time: 0.7698548 May 25 15:42:47.915122 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56246) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:47.923832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-c1875354-1081-4ae2-bfe2-4574a3e00777 req-2f69f909-4924-4c1a-af84-1ee41bcbb241 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Synchronizing usage tracker for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:47.956427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-c1875354-1081-4ae2-bfe2-4574a3e00777 req-2f69f909-4924-4c1a-af84-1ee41bcbb241 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Unset dirty status for tenant:4d321f2af3214e7d853ab4248bfea864 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:47.957291 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c1875354-1081-4ae2-bfe2-4574a3e00777 req-2f69f909-4924-4c1a-af84-1ee41bcbb241 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.1109891 May 25 15:42:47.981622 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49021175-4340-475d-a01a-cce0bbe86386 req-992172ab-27ac-4800-9fa5-98ad14db15d2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.983010 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-49021175-4340-475d-a01a-cce0bbe86386 req-992172ab-27ac-4800-9fa5-98ad14db15d2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 943 time: 0.1038697 May 25 15:42:48.009216 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Deleting subnet a81be0c1-2b95-408e-8648-21cb51a49058 {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:42:48.014561 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-64919c5f-e6f4-4107-9329-24e89dfbd646 service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2119639 May 25 15:42:48.015198 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.030828 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-49021175-4340-475d-a01a-cce0bbe86386 req-e25b2169-de66-459c-b209-27496b495e70 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412171 May 25 15:42:48.143507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.228292 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.259266 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-67d8ea22-e7d7-40af-9844-4a961a6977fc req-d739e886-8192-4bee-90c7-1e2a638cac85 service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2174168 May 25 15:42:48.485897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.490496 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0bd3f7e7-9b02-4734-8b55-58274f2205b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.525222 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a81be0c1-2b95-408e-8648-21cb51a49058,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:48.527081 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.529514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.533506 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1b2b3ca1-a210-4208-9b31-ee984197b590 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/a81be0c1-2b95-408e-8648-21cb51a49058 HTTP/1.1" status: 204 len: 168 time: 0.6173704 May 25 15:42:48.535986 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56254) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:48.647839 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.777148 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.798017 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['44aa62f4-dc01-435b-bf01-a88d1d83c9a0']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:48.812144 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e9166690-fefd-42fa-a6cd-1c94450d3363') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:48.812532 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e9166690-fefd-42fa-a6cd-1c94450d3363') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:48.824108 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.840570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.846785 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Releasing vlan 824 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:42:48.847189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.858007 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea93783-f2f0-47a4-bb04-ad275f4c82be req-a9251cd3-c877-4972-a96e-fd4ad0be448b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:48.859377 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ea93783-f2f0-47a4-bb04-ad275f4c82be req-a9251cd3-c877-4972-a96e-fd4ad0be448b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.1359034 May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:42:48.861137 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:42:48.925645 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ea93783-f2f0-47a4-bb04-ad275f4c82be req-983e6b8e-f63b-4ec9-aa0c-4413d84f897a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561957 May 25 15:42:48.937570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.942005 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e53d3bc5-cd01-4502-b9f5-7f2546963b8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.945936 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827686e9-e118-4838-a2d5-7555f7100382 req-ac87b499-446b-426c-ada3-488432b02e05 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:48.947412 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-827686e9-e118-4838-a2d5-7555f7100382 req-ac87b499-446b-426c-ada3-488432b02e05 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1356077 May 25 15:42:48.963024 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:48.969865 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Pushing event deleted for resources: {'Network': ['ID=44aa62f4-dc01-435b-bf01-a88d1d83c9a0,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:48.972726 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.974579 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-85b18479-74f0-420b-9444-bc1c9bb77adb admin admin] 10.222.0.25 "DELETE /v2.0/networks/44aa62f4-dc01-435b-bf01-a88d1d83c9a0 HTTP/1.1" status: 204 len: 168 time: 0.4376500 May 25 15:42:49.004546 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-827686e9-e118-4838-a2d5-7555f7100382 req-1d8cd460-65d9-4386-8684-d51bb7883b7e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476964 May 25 15:42:49.113893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56274) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:49.185030 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7f6ceaf3-2d6f-4fdf-85e0-f6c7202de1e0 req-5d45ec56-c416-43ed-b248-455d6c4f79b7 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] 10.222.0.25 "GET /v2.0/ports?device_id=98918df2-2c75-4aad-92a7-cdd2e109424e HTTP/1.1" status: 200 len: 210 time: 0.0550873 May 25 15:42:49.225795 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4c90203b-2df1-4e05-b031-dbaaa98901cc admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d7112359f9e947e3ae4f12025d5ca5af&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1082664 May 25 15:42:49.226035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56280) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:49.281994 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73cac064-2d02-401c-bb22-890fdda0d24a details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:49.358487 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.382534 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7419a716-d007-4a15-b76a-b2fab31ad689 req-afe2ebf3-c3a9-424b-9440-644c8bfe3d0a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:49.384196 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7419a716-d007-4a15-b76a-b2fab31ad689 req-afe2ebf3-c3a9-424b-9440-644c8bfe3d0a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 943 time: 0.1453290 May 25 15:42:49.421041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.463029 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73cac064-2d02-401c-bb22-890fdda0d24a,segment=NetworkSegment(01e89f68-a28a-4109-a6b7-004659c4f358),segment_id=01e89f68-a28a-4109-a6b7-004659c4f358)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:49.472025 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7419a716-d007-4a15-b76a-b2fab31ad689 req-1a8705f3-76d0-40ee-b694-ad73c7faf836 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796797 May 25 15:42:49.484381 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '73cac064-2d02-401c-bb22-890fdda0d24a', 'network_id': 'bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd', 'port_id': '73cac064-2d02-401c-bb22-890fdda0d24a', 'mac_address': 'fa:16:3e:af:d6:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 837, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8359c6d8-0d8a-4f13-a065-36bfd3350e4a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:49.505536 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.513119 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b9852e0c-8562-447d-84be-59bfa1e3cd1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.526303 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b2435db-3eb8-4730-8ccf-cadc6791a024,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:49.529863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.532039 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.533274 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1b2435db-3eb8-4730-8ccf-cadc6791a024 HTTP/1.1" status: 204 len: 168 time: 0.3061261 May 25 15:42:49.561750 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.580436 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 73cac064-2d02-401c-bb22-890fdda0d24a {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:49.598493 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73cac064-2d02-401c-bb22-890fdda0d24a,segment=NetworkSegment(01e89f68-a28a-4109-a6b7-004659c4f358),segment_id=01e89f68-a28a-4109-a6b7-004659c4f358)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:49.602582 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:49.604566 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.697051 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:49.705791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.955201 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56302) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:50.005130 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-56adc6c5-d64b-4875-a3a4-80eeee879ee0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=bf0c84df4fac4f2fb02e003374cafe9f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0486383 May 25 15:42:50.007475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56306) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:50.067592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.095266 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.198379 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.204005 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7b3a7591-257c-4e6e-9891-9cbfe4e414cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.220002 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ebdc88c-d6e2-496c-8023-bee18f909780,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:50.223912 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.227890 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.229065 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3ebdc88c-d6e2-496c-8023-bee18f909780 HTTP/1.1" status: 204 len: 168 time: 0.2206459 May 25 15:42:50.238301 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b253c4-bb12-4cb0-843b-a01fd0285bf2 req-f6f09abc-98dc-44bd-b547-016ca3bf9978 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:50.239798 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d6b253c4-bb12-4cb0-843b-a01fd0285bf2 req-f6f09abc-98dc-44bd-b547-016ca3bf9978 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1115589 May 25 15:42:50.288995 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d6b253c4-bb12-4cb0-843b-a01fd0285bf2 req-3c1f0932-06bb-41c3-aeed-988504f63725 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430744 May 25 15:42:50.322931 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['73cac064-2d02-401c-bb22-890fdda0d24a'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:50.704825 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3639bc0d-848b-4f2d-8a27-345b060a6df2 req-8cf8950b-26c3-47ed-bd28-404909ec96bd tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:50.706344 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3639bc0d-848b-4f2d-8a27-345b060a6df2 req-8cf8950b-26c3-47ed-bd28-404909ec96bd tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 944 time: 0.0941577 May 25 15:42:50.767809 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3639bc0d-848b-4f2d-8a27-345b060a6df2 req-6054f061-36d5-4e41-b765-6170b43eeb92 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399981 May 25 15:42:51.459018 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56364) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:51.484640 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef6a1ac-da75-4d68-9872-e5df713aeac4 req-4dd082d6-3b7b-4375-81ed-e295d9cccf34 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:51.486026 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6ef6a1ac-da75-4d68-9872-e5df713aeac4 req-4dd082d6-3b7b-4375-81ed-e295d9cccf34 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0851121 May 25 15:42:51.530876 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6ef6a1ac-da75-4d68-9872-e5df713aeac4 req-131cb088-58ed-4d12-8925-cab39efec237 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389905 May 25 15:42:51.578664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.593931 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:51.597881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Usage tracker for resource:security_group_rule and tenant:e02f7a6043814113a87cac5ecdfd3fc5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:51.600725 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:51.606526 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:51.691232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.695608 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.702969 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-450a9192-9ab1-470f-a365-e5acf7b9fb2e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.746167 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e02f7a6043814113a87cac5ecdfd3fc5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2858782 May 25 15:42:51.746992 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfcbcbe4-82f7-4a98-920a-e6a3cd3f34b3,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:51.749018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56370) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:51.750177 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.818864 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.848121 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.955777 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.961074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3fc289da-6be4-448b-8398-7c0b1206829d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.977580 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfcbcbe4-82f7-4a98-920a-e6a3cd3f34b3,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:51.984852 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.989449 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:51.993059 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cfcbcbe4-82f7-4a98-920a-e6a3cd3f34b3 HTTP/1.1" status: 204 len: 168 time: 0.2419817 May 25 15:42:52.009801 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56388) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:52.049511 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808425cc-098a-4547-bad0-2fad1b3bc401 req-b329ccdb-df37-42f6-af98-1d9a8b3e0e08 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:52.058530 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-808425cc-098a-4547-bad0-2fad1b3bc401 req-b329ccdb-df37-42f6-af98-1d9a8b3e0e08 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 944 time: 0.1682537 May 25 15:42:52.092198 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Deleting subnet 109089f6-966f-46c3-ac4d-c0610e95a24b {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:42:52.099538 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.120572 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-808425cc-098a-4547-bad0-2fad1b3bc401 req-e5258346-9ca5-4b70-a118-584a97f754b2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605819 May 25 15:42:52.167644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.243691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.524100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-7fcc7773-3d7b-4dae-bf21-3f8de231fb27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:52.525949 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-7fcc7773-3d7b-4dae-bf21-3f8de231fb27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1786017 May 25 15:42:52.548547 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-3d0bfb87-3e3f-4103-a61c-580e4b0b814a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/quotas/fe662b5dcc2c4a1da1aa9473bd7e9dd7 HTTP/1.1" status: 200 len: 375 time: 0.0158386 May 25 15:42:52.624756 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.629687 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.670507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=109089f6-966f-46c3-ac4d-c0610e95a24b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:52.673087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.677694 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.699140 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/109089f6-966f-46c3-ac4d-c0610e95a24b HTTP/1.1" status: 204 len: 168 time: 0.6880431 May 25 15:42:52.702200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56426) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:52.731865 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-7a0a7d18-9f05-4ad7-9013-c15b4478c419 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1818805 May 25 15:42:52.970114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.064123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-aab9b64c-2765-4757-8ed4-30f531c359dd service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2722309 May 25 15:42:53.073633 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ff5577-7d95-4969-beff-9635e53e7399 req-ef7f5be3-e3c3-47f9-a322-8bf0e19e8a60 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:53.075575 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5ff5577-7d95-4969-beff-9635e53e7399 req-ef7f5be3-e3c3-47f9-a322-8bf0e19e8a60 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2827301 May 25 15:42:53.245671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.268845 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93554588-43bc-41aa-b595-47bd440305fb']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:53.287109 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12684b13-b98f-4241-9d70-842214716852') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:53.287401 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12684b13-b98f-4241-9d70-842214716852') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:53.305598 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5ff5577-7d95-4969-beff-9635e53e7399 req-1bb9a717-c2ef-4579-9bbe-e20c57568888 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1653185 May 25 15:42:53.305939 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73cac064-2d02-401c-bb22-890fdda0d24a up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:53.316566 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.347481 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-3e169827-edc7-4f69-a9e1-e4789614f378 service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2709622 May 25 15:42:53.348427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.358362 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Releasing vlan 802 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:42:53.358769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:42:53.375009 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:42:53.450167 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 73cac064-2d02-401c-bb22-890fdda0d24a completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:53.457882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 73cac064-2d02-401c-bb22-890fdda0d24a triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:53.458508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.535701 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.539540 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.560771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.603152 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Pushing event deleted for resources: {'Network': ['ID=93554588-43bc-41aa-b595-47bd440305fb,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:53.618573 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.643596 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] 10.222.0.25 "DELETE /v2.0/networks/93554588-43bc-41aa-b595-47bd440305fb HTTP/1.1" status: 204 len: 168 time: 0.9386990 May 25 15:42:53.657130 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.669635 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c291ad3e-558e-48b7-a351-39a49d08e61f req-bdfb2491-661c-4e09-a35f-234216a6beb2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:53.671112 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c291ad3e-558e-48b7-a351-39a49d08e61f req-bdfb2491-661c-4e09-a35f-234216a6beb2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 944 time: 0.1053700 May 25 15:42:53.696128 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:53.707447 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73cac064-2d02-401c-bb22-890fdda0d24a,segment=NetworkSegment(01e89f68-a28a-4109-a6b7-004659c4f358),segment_id=01e89f68-a28a-4109-a6b7-004659c4f358)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:53.714168 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:53.716962 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.734797 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c291ad3e-558e-48b7-a351-39a49d08e61f req-b6a2cc99-586e-48ff-9a7d-5be18f5ebbee tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573997 May 25 15:42:53.793323 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:53.803305 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.860481 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0285223-7129-4719-a7d2-18e01405c2f4 req-855bff42-06d9-4705-8396-63a493dc18b9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 210 time: 0.0558171 May 25 15:42:53.903199 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a', 'code': 200} May 25 15:42:53.907824 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56462) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:53.957218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5321b5d3-1b59-46ad-9aff-f301c1ff9729 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4d321f2af3214e7d853ab4248bfea864&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0482316 May 25 15:42:53.959808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56466) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:54.020341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:54.050810 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:54.112080 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:54.116862 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1f745245-bda9-41e9-acc3-381d4bd55dff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:54.131168 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b829a5c6-1f8b-4e38-893d-5965279c6b75,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:54.141589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:54.155025 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:54.156551 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b829a5c6-1f8b-4e38-893d-5965279c6b75 HTTP/1.1" status: 204 len: 168 time: 0.1958470 May 25 15:42:54.484525 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c161c13a-0a04-4878-bcbd-650f95400836 req-8185bc48-2ac0-4a1a-b5c3-ab24f6f8cd80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.486807 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c161c13a-0a04-4878-bcbd-650f95400836 req-8185bc48-2ac0-4a1a-b5c3-ab24f6f8cd80 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 1098 time: 0.0864499 May 25 15:42:54.552113 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f9d1af-1f21-4ee6-98e2-a81794577a02 req-75f478bf-832b-4ff8-9eec-961ec249a4cb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.553620 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3f9d1af-1f21-4ee6-98e2-a81794577a02 req-75f478bf-832b-4ff8-9eec-961ec249a4cb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0988224 May 25 15:42:54.561125 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c161c13a-0a04-4878-bcbd-650f95400836 req-83381258-efb4-4949-9cac-69a707c13ba9 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500312 May 25 15:42:54.605706 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3f9d1af-1f21-4ee6-98e2-a81794577a02 req-925c9dca-3b9e-498b-9b2b-bfca15fffe8a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453610 May 25 15:42:54.901253 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-5c56d457-3c74-4e91-ae31-305805afdd43 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=f21f28becb8940c78e4bf7cf3035f950&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0628450 May 25 15:42:55.067811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c74f96-baaf-4184-9fc1-2531a658145a req-b00f9615-0b9f-492d-9a46-cf6519ab8635 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.069248 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13c74f96-baaf-4184-9fc1-2531a658145a req-b00f9615-0b9f-492d-9a46-cf6519ab8635 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.2012873 May 25 15:42:55.079984 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e7f6f5ce-3b38-4e53-b982-cac52f20752a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.081382 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e7f6f5ce-3b38-4e53-b982-cac52f20752a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1746531 May 25 15:42:55.110779 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-ce176d66-345c-4f9d-b298-ad0d7ac67e64 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/quotas/f21f28becb8940c78e4bf7cf3035f950 HTTP/1.1" status: 200 len: 375 time: 0.0151944 May 25 15:42:55.244361 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-c8b23e00-96d1-4b78-9cc0-9a048c4447d7 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=f21f28becb8940c78e4bf7cf3035f950&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1264307 May 25 15:42:55.247838 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13c74f96-baaf-4184-9fc1-2531a658145a req-edb75c08-3c99-473f-8ce7-d0d24d6a41d0 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1655939 May 25 15:42:55.489454 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c10a4457-3c4e-4c7a-8182-f12c79c050c5 req-fb656534-9dea-4948-97f0-e58a86870dd7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 210 time: 0.0447452 May 25 15:42:55.637798 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0760f6e-7de1-46cb-a77e-f2a4d2c531ae req-269d6c41-cec4-402d-b5ee-e790b9b13349 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 210 time: 0.0545647 May 25 15:42:55.830552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2203aad-6280-40bc-b038-c0a11b62d3db req-90eb0d78-9c85-4b29-b675-f8f8d6bed48f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.832034 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d2203aad-6280-40bc-b038-c0a11b62d3db req-90eb0d78-9c85-4b29-b675-f8f8d6bed48f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0882142 May 25 15:42:55.885994 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d2203aad-6280-40bc-b038-c0a11b62d3db req-a0f410a1-67f1-4290-b0d4-71f417155fdb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400615 May 25 15:42:56.483865 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f2262a-b28c-40ce-8a6c-7daa522e9340 req-a5cbe99d-6a0f-47dc-8ed4-fe44eef88318 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:56.485799 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16f2262a-b28c-40ce-8a6c-7daa522e9340 req-a5cbe99d-6a0f-47dc-8ed4-fe44eef88318 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.1141675 May 25 15:42:56.543704 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-3c2346fc-9d07-4dec-991a-ca44fc835251 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:56.547288 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-3c2346fc-9d07-4dec-991a-ca44fc835251 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1814790 May 25 15:42:56.571726 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16f2262a-b28c-40ce-8a6c-7daa522e9340 req-b52f4ee6-51ac-4525-b076-a61ab35242b1 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800557 May 25 15:42:56.609997 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Request body: {'port': {'device_id': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'admin_state_up': True, 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:56.684049 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a168d743-1288-435a-9b4b-5cbed2b2b9d5 req-2a9110cf-4a42-45da-a608-d3ee88a35c94 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 210 time: 0.0497563 May 25 15:42:56.756739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:56.760786 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Usage tracker for resource:port and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:56.763777 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:56.769430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:56.781602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:56.785236 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:56.837952 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-78010419-70ae-4794-952b-7a63485f6ca7 req-c468a99b-d03a-4a57-8c97-4215c73e26d1 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 210 time: 0.0483916 May 25 15:42:56.958490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Allocated IP 172.20.0.9 (956d5f61-ae8e-4c95-bd97-6ae439ceff67/bf87cdb0-06e4-4ee0-ad97-e62e40212515/fff1b5a9-eacd-47e1-8a7e-666b346d4163) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:57.076910 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75052c8f-b7ad-430b-a179-0c3b316c015d req-8970a9fa-8e7a-4aef-a45a-515a798be889 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.078369 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-75052c8f-b7ad-430b-a179-0c3b316c015d req-8970a9fa-8e7a-4aef-a45a-515a798be889 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0824082 May 25 15:42:57.121765 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-75052c8f-b7ad-430b-a179-0c3b316c015d req-fef49a3e-2567-4644-a70f-e9886e02d983 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372641 May 25 15:42:57.174387 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:57.203986 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:57.210239 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d66ab365-d0f3-482b-a8a1-01e30bd67d26 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.276080 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:57.279968 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:57.283988 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:57.293573 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:57.323793 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event updated for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:57.327853 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.375719 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.376853 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:57.413195 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8094714 May 25 15:42:57.651827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Request body: {'port': {'device_id': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:57.797570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:57.813231 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb1348b-d90e-4c3e-9458-a5699e82e0a1 req-7435c364-ba0e-4b02-a153-b1f33b47b2e6 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.816232 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcb1348b-d90e-4c3e-9458-a5699e82e0a1 req-7435c364-ba0e-4b02-a153-b1f33b47b2e6 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.1336195 May 25 15:42:57.919885 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcb1348b-d90e-4c3e-9458-a5699e82e0a1 req-e6952926-5b0c-45ae-8fe3-0d0aad09d43e tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959494 May 25 15:42:57.955962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad0db30-5a0a-4ac4-82d9-977b8a15f5fd req-c2367f58-c5df-4714-a569-15d8c752f8f2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.957644 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bad0db30-5a0a-4ac4-82d9-977b8a15f5fd req-c2367f58-c5df-4714-a569-15d8c752f8f2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 931 time: 0.1327374 May 25 15:42:58.028422 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-739c6113-a210-4d85-84eb-10d55ab4bc86 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.74 "GET /v2.0/networks?tenant_id=f21f28becb8940c78e4bf7cf3035f950&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0420642 May 25 15:42:58.089130 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bad0db30-5a0a-4ac4-82d9-977b8a15f5fd req-8f2deb95-87a5-4513-bb96-57cc49098fa6 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1209834 May 25 15:42:58.208143 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f4775947-0d80-4d27-bd64-4de379d4fdc9 req-b5fffdb3-b067-4eb5-ae0c-3dd4c304d1fe tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 210 time: 0.1259501 May 25 15:42:58.256562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fff1b5a9-eacd-47e1-8a7e-666b346d4163 {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:58.265753 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.283002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Transition to ACTIVE for port object fff1b5a9-eacd-47e1-8a7e-666b346d4163 will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:58.289601 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.299342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-faebfb80-66dc-4936-91b1-a666a3e4a87a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:58.299766 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-53c41e0c-c704-4d99-86e7-e5a9b8f0c895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.300821 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-faebfb80-66dc-4936-91b1-a666a3e4a87a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.74 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2478375 May 25 15:42:58.372934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Request body: {'port': {'device_id': '95555d56-393e-4997-95ac-a3e530ab54a9', 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39', 'admin_state_up': True, 'tenant_id': 'f21f28becb8940c78e4bf7cf3035f950'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:58.491581 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538483f-2d1a-442e-bf58-3d6fa6c3bc52 req-32b92ed5-1311-458d-b6e5-83dd9acd4de5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:58.493078 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d538483f-2d1a-442e-bf58-3d6fa6c3bc52 req-32b92ed5-1311-458d-b6e5-83dd9acd4de5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1839962 May 25 15:42:58.574795 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:58.582826 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d538483f-2d1a-442e-bf58-3d6fa6c3bc52 req-79ca2e56-caa1-40a4-b63e-35e65f0b9076 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737662 May 25 15:42:58.583752 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Usage tracker for resource:port and tenant:f21f28becb8940c78e4bf7cf3035f950 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:58.586666 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:58.586790 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Pushing event updated for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:58.592288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.595979 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:58.606830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Made reservation on behalf of f21f28becb8940c78e4bf7cf3035f950 for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:58.610255 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.622528 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.634976 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Attempting to bind port fff1b5a9-eacd-47e1-8a7e-666b346d4163 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:58.635314 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Attempting to bind port fff1b5a9-eacd-47e1-8a7e-666b346d4163 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:58.635682 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Attempting to bind port fff1b5a9-eacd-47e1-8a7e-666b346d4163 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:58.641897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Port fff1b5a9-eacd-47e1-8a7e-666b346d4163 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:58.642071 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:58.642264 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Attempting to bind port fff1b5a9-eacd-47e1-8a7e-666b346d4163 on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:58.646018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Usage tracker for resource:security_group_rule and tenant:f21f28becb8940c78e4bf7cf3035f950 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:58.648344 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:58.648344 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Checking segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:58.648344 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Bound using segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:58.648918 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Bound port: fff1b5a9-eacd-47e1-8a7e-666b346d4163, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:58.649140 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:58.649243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.655415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:58.742076 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:58.745362 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:58.749110 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.749245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.752921 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-378f752f-c5b7-417e-a776-0e0234cc3df5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.755474 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.758371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fd94208a-ea48-4b76-9433-f3f8abd84bb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.816293 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:58.816896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:58.818245 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] 10.222.0.74 "PUT /v2.0/ports/fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 200 len: 1093 time: 1.1846945 May 25 15:42:58.818800 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:58.839928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df8965eb-a4a2-4197-a460-624892238884,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:58.846462 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.857670 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Pushing event updated for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:58.860708 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.898179 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'status': 'completed', 'code': 200} May 25 15:42:58.936559 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Allocated IP 192.168.233.76 (b9eb3a46-b38b-4466-b035-073a858cfd39/dbd03780-5c02-4fbd-82c5-313c0ebd02fc/91fd6866-2658-4226-ac3b-718c3cc2a0e4) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:59.109760 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9b55c291-ca9b-4ccd-9edd-0cc12cfca67c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.215294 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-e62ee53a-b98d-4cfd-9cfa-d63a3cc907fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.217913 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-e62ee53a-b98d-4cfd-9cfa-d63a3cc907fa service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1096 time: 0.1447358 May 25 15:42:59.243263 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56638) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:59.334589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.344876 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6ce7f3-d71f-4ffb-a89c-ba95ba1b5a68 req-b6541bd4-7f50-44cb-8215-c6128a2e794d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.346331 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca6ce7f3-d71f-4ffb-a89c-ba95ba1b5a68 req-b6541bd4-7f50-44cb-8215-c6128a2e794d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.2760971 May 25 15:42:59.395128 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Transition to ACTIVE for port object 91fd6866-2658-4226-ac3b-718c3cc2a0e4 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:59.395775 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.420417 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:59.434706 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca6ce7f3-d71f-4ffb-a89c-ba95ba1b5a68 req-4c8100fc-9805-41b6-8e88-2ff44748eb86 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779183 May 25 15:42:59.436213 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Usage tracker for resource:security_group_rule and tenant:e0875dbcd1914b4fbc6b884e9588cf5b is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:59.440657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:59.451252 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:59.455542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90dcf4d6-9c8a-4d34-af27-782ad6a6860f req-d5d943e0-6a2b-4f79-983d-0d8034bf850b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.457000 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-90dcf4d6-9c8a-4d34-af27-782ad6a6860f req-d5d943e0-6a2b-4f79-983d-0d8034bf850b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 943 time: 0.2332175 May 25 15:42:59.479894 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-c6447ace-35ae-4346-84dc-291ea9456a18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.482050 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-c6447ace-35ae-4346-84dc-291ea9456a18 service neutron] 10.222.0.74 "GET /v2.0/networks?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1902161 May 25 15:42:59.500890 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.514690 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.559497 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-90dcf4d6-9c8a-4d34-af27-782ad6a6860f req-e28f2192-ebe8-48af-ac30-76c4248ab6d7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957654 May 25 15:42:59.592637 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Network b9eb3a46-b38b-4466-b035-073a858cfd39 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:59.593968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:59.598129 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:59.641972 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:59.724031 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.759332 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.759990 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.764691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-6ef05219-63ff-4d5f-b8ec-bab10943ffde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.766197 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-3700d30e-fe49-4fac-aea3-b1ec74f6c9c0 req-6ef05219-63ff-4d5f-b8ec-bab10943ffde service neutron] 10.222.0.74 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2659125 May 25 15:42:59.795828 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.802795 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.810859 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-a42f4980-41f3-44f7-b1c2-d51e898d99d2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.811588 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-a42f4980-41f3-44f7-b1c2-d51e898d99d2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Synchronizing usage tracker for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:59.812831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.821045 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4536269 May 25 15:42:59.845704 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-a42f4980-41f3-44f7-b1c2-d51e898d99d2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Unset dirty status for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:59.847443 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed42ee44-0f25-4ad1-8635-2b30f4c69cae,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:59.848315 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-a42f4980-41f3-44f7-b1c2-d51e898d99d2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 935 time: 0.2191222 May 25 15:42:59.856939 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.871364 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e0875dbcd1914b4fbc6b884e9588cf5b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6248801 May 25 15:42:59.871651 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56690) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:59.912011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c8365fae-7215-424d-ba07-64d23f34faf7 None None] Provisioning for port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:59.914919 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Request body: {'port': {'device_id': '95555d56-393e-4997-95ac-a3e530ab54a9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:59.926828 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c8365fae-7215-424d-ba07-64d23f34faf7 None None] Provisioning complete for port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:59.927701 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c8365fae-7215-424d-ba07-64d23f34faf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:59.970208 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-f9a2f90c-91fa-4898-886f-44bcbafaa4f3 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Synchronizing usage tracker for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:59.987889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-c8365fae-7215-424d-ba07-64d23f34faf7 None None] Port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:43:00.011809 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.047136 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.052445 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-f9a2f90c-91fa-4898-886f-44bcbafaa4f3 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Unset dirty status for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:00.053733 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-777b7958-23e5-4a90-8072-6bab89fe4466 req-f9a2f90c-91fa-4898-886f-44bcbafaa4f3 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1894543 May 25 15:43:00.067260 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.092885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-192d96bd-09af-4f7e-b679-3980cfefa545 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:00.094335 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-192d96bd-09af-4f7e-b679-3980cfefa545 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1096 time: 0.1515696 May 25 15:43:00.119269 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.126301 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.215123 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed42ee44-0f25-4ad1-8635-2b30f4c69cae,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:00.217316 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.246325 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-ea70728d-f132-412a-9de1-2680ee6d6931 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 200 len: 217 time: 0.1210065 May 25 15:43:00.262425 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.263826 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ed42ee44-0f25-4ad1-8635-2b30f4c69cae HTTP/1.1" status: 204 len: 168 time: 0.3901744 May 25 15:43:00.349544 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-4fd7a0cc-d82a-4ee2-aba6-5b44d3f58960 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:00.351246 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-4fd7a0cc-d82a-4ee2-aba6-5b44d3f58960 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0860891 May 25 15:43:00.421867 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-9660171b-e820-4a72-859e-f849995efc7b service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0558589 May 25 15:43:00.474364 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7df333c-576c-4887-a282-e8897608633e req-bec1f54e-aa12-409b-9b99-11854c994d9f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:00.480358 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7df333c-576c-4887-a282-e8897608633e req-bec1f54e-aa12-409b-9b99-11854c994d9f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2844162 May 25 15:43:00.573482 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-4af06684-7ab1-4fe5-8c7f-49092e88b2e8 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1364760 May 25 15:43:00.582741 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7df333c-576c-4887-a282-e8897608633e req-86c2ea28-ed77-4bb4-866b-19b2e590a2f7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011741 May 25 15:43:00.586964 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 91fd6866-2658-4226-ac3b-718c3cc2a0e4 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:00.602739 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.621952 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Transition to ACTIVE for port object 91fd6866-2658-4226-ac3b-718c3cc2a0e4 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:43:00.626226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.632694 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.664507 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56704) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:00.739437 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9f6cbeaf-b16b-4cd5-b124-6ce71a25208e req-61b30e6e-8bc8-461e-b0d2-8733666e645c service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509185 May 25 15:43:00.760499 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.900445 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:00.914568 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Usage tracker for resource:security_group_rule and tenant:065cd433eb7344229c3f4b7c248d0ef2 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:00.923421 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:00.926143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:00.937194 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:00.939207 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.993790 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Attempting to bind port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:43:00.994130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Attempting to bind port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:43:00.994456 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Attempting to bind port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 on network b9eb3a46-b38b-4466-b035-073a858cfd39 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:01.012555 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e6b2a6-6fb7-4eab-bece-ed688e01226d req-710c67ae-2a98-46d9-b94f-0e6c997b5780 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.014578 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a4e6b2a6-6fb7-4eab-bece-ed688e01226d req-710c67ae-2a98-46d9-b94f-0e6c997b5780 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 943 time: 0.3154798 May 25 15:43:01.016329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 on network b9eb3a46-b38b-4466-b035-073a858cfd39 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:43:01.016646 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Attempting to bind port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 on network b9eb3a46-b38b-4466-b035-073a858cfd39 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:01.044270 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:43:01.044546 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Checking segment: {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:43:01.044939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Bound using segment: {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:43:01.045417 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Bound port: 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e59bb930-6f45-4068-949e-e382d6e561f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:43:01.045955 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.151602 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a4e6b2a6-6fb7-4eab-bece-ed688e01226d req-d4984c98-bf5f-4615-b45d-fbd0b5d9fc49 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1289153 May 25 15:43:01.196589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.201329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:43:01.204882 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:43:01.205819 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.212669 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26eeb67a-f7ea-435c-9020-f33e13885e65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.222248 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.263771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39279ac5-2f43-4e72-a2e6-ddc3b86669d7,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:01.270115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.270718 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.272058 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] 10.222.0.74 "PUT /v2.0/ports/91fd6866-2658-4226-ac3b-718c3cc2a0e4 HTTP/1.1" status: 200 len: 1097 time: 1.3670888 May 25 15:43:01.323238 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.326258 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=065cd433eb7344229c3f4b7c248d0ef2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6607294 May 25 15:43:01.326859 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:01.329266 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56728) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:01.331231 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.401023 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.435827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.528021 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.533689 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.539135 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b851e90e-0fe2-4c36-a1ae-223be63d5399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.551991 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39279ac5-2f43-4e72-a2e6-ddc3b86669d7,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:01.555839 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.561700 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.562903 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/39279ac5-2f43-4e72-a2e6-ddc3b86669d7 HTTP/1.1" status: 204 len: 168 time: 0.2323802 May 25 15:43:01.617891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:01.621760 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.648605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeed9c13-f549-4448-88c2-21a0ba80de0f req-9bf1a144-3481-4396-96d6-e67aea90049a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.650359 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aeed9c13-f549-4448-88c2-21a0ba80de0f req-9bf1a144-3481-4396-96d6-e67aea90049a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 947 time: 0.3882167 May 25 15:43:01.679040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-8f3a761d-2d25-4298-a009-335e08cf7476 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.680606 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-8f3a761d-2d25-4298-a009-335e08cf7476 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=f21f28becb8940c78e4bf7cf3035f950&device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 1100 time: 0.2784879 May 25 15:43:01.692440 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e815cea7-9200-494e-a687-3790e2b1285c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:01.762306 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'status': 'completed', 'code': 200} May 25 15:43:01.782496 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-222916d4-ca11-48de-bd6f-a2a10837afbc service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.76&port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4 HTTP/1.1" status: 200 len: 217 time: 0.0720468 May 25 15:43:01.786502 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aeed9c13-f549-4448-88c2-21a0ba80de0f req-b23b82bf-c641-4666-a51d-7434c3deb717 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225135 May 25 15:43:01.908751 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-b85c703d-abf2-46bb-a97f-771a7143ca93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.910257 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-b85c703d-abf2-46bb-a97f-771a7143ca93 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=dbd03780-5c02-4fbd-82c5-313c0ebd02fc HTTP/1.1" status: 200 len: 843 time: 0.1138670 May 25 15:43:01.985079 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacc2493-4a66-4fda-9e55-6d54ece59287 req-4930cfc3-6e35-46a5-8288-97415a567723 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.986515 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cacc2493-4a66-4fda-9e55-6d54ece59287 req-4930cfc3-6e35-46a5-8288-97415a567723 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1553521 May 25 15:43:02.045438 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cacc2493-4a66-4fda-9e55-6d54ece59287 req-eb8fe55e-4089-468f-b189-af63bdb98904 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523953 May 25 15:43:02.047590 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-f0d69239-4f4d-47a5-85cd-f0865e295717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.048966 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-f0d69239-4f4d-47a5-85cd-f0865e295717 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=b9eb3a46-b38b-4466-b035-073a858cfd39&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1199918 May 25 15:43:02.194079 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-61859ac3-c729-4bca-aede-4b207e4b1ab0 service neutron] 10.222.0.74 "GET /v2.0/networks/b9eb3a46-b38b-4466-b035-073a858cfd39?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1312573 May 25 15:43:02.412232 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13279b0a-7a2a-4dcd-983c-f71f780f4267 req-14f0b140-9724-40ee-a37c-47c8d645376a service neutron] 10.222.0.74 "GET /v2.0/networks/b9eb3a46-b38b-4466-b035-073a858cfd39?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2055399 May 25 15:43:02.426031 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063c20e5-e8fa-4ca8-92b5-4ef46e4dd21a req-08f86d0f-af0e-4bcd-9411-311ad70a9658 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.427734 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-063c20e5-e8fa-4ca8-92b5-4ef46e4dd21a req-08f86d0f-af0e-4bcd-9411-311ad70a9658 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 943 time: 0.1425712 May 25 15:43:02.477942 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-063c20e5-e8fa-4ca8-92b5-4ef46e4dd21a req-23f8eb83-b2cd-4fab-aaab-a87df21062c4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428240 May 25 15:43:02.656819 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:02.739674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-cad33e52-1bf4-4c39-8c51-144ac556040e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.740462 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-cad33e52-1bf4-4c39-8c51-144ac556040e service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=f21f28becb8940c78e4bf7cf3035f950&device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 1100 time: 0.0837691 May 25 15:43:02.898394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-5cf912e6-495d-4889-960c-4b6e08c88660 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.899838 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-5cf912e6-495d-4889-960c-4b6e08c88660 service neutron] 10.222.0.74 "GET /v2.0/networks?id=b9eb3a46-b38b-4466-b035-073a858cfd39 HTTP/1.1" status: 200 len: 870 time: 0.1426873 May 25 15:43:03.013683 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-11dbb21f-852b-416c-906e-6c85eaff227e service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.76&port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4 HTTP/1.1" status: 200 len: 217 time: 0.0930963 May 25 15:43:03.111121 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-923ec4d9-7fd7-4575-97f0-f6614daafe2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.112728 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-923ec4d9-7fd7-4575-97f0-f6614daafe2e service neutron] 10.222.0.74 "GET /v2.0/subnets?id=dbd03780-5c02-4fbd-82c5-313c0ebd02fc HTTP/1.1" status: 200 len: 843 time: 0.0789981 May 25 15:43:03.129765 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b557df6-0cb5-4ed3-9e67-9841087e3685 req-a949d9f7-c508-400d-8e19-f2c306acc646 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.131511 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b557df6-0cb5-4ed3-9e67-9841087e3685 req-a949d9f7-c508-400d-8e19-f2c306acc646 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 947 time: 0.1552758 May 25 15:43:03.287184 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b557df6-0cb5-4ed3-9e67-9841087e3685 req-4ea099d0-18c4-4078-98a3-910519c4ba68 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1198721 May 25 15:43:03.306625 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-bc7de9a1-5997-4fbc-abaa-d4de4757ea1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.308128 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-bc7de9a1-5997-4fbc-abaa-d4de4757ea1d service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=b9eb3a46-b38b-4466-b035-073a858cfd39&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1756945 May 25 15:43:03.316190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5249bc-aa4e-4c47-aace-16f3b8dac0f3 req-5a78b5d4-f029-4bd0-bbfc-752d4d9a24bb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.317598 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b5249bc-aa4e-4c47-aace-16f3b8dac0f3 req-5a78b5d4-f029-4bd0-bbfc-752d4d9a24bb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1492906 May 25 15:43:03.342764 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fff1b5a9-eacd-47e1-8a7e-666b346d4163 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:43:03.447657 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b5249bc-aa4e-4c47-aace-16f3b8dac0f3 req-a77154b5-936b-4684-b4cd-334803b5ba6a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114490 May 25 15:43:03.508829 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-7f3407b2-643b-47fe-bad6-7b203b7f2005 service neutron] 10.222.0.74 "GET /v2.0/networks/b9eb3a46-b38b-4466-b035-073a858cfd39?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1902094 May 25 15:43:03.509716 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:03.525296 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'port_id': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'mac_address': 'fa:16:3e:93:57:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 836, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf87cdb0-06e4-4ee0-ad97-e62e40212515', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:43:03.585739 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:03.609170 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fff1b5a9-eacd-47e1-8a7e-666b346d4163 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:03.644165 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:03.649968 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:03.652124 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.730435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:03.734116 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.827166 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d73beece-c1ab-409c-808c-e9057f385ac3 req-b0549554-be4a-4087-ac2a-13b9d01eef7a service neutron] 10.222.0.74 "GET /v2.0/networks/b9eb3a46-b38b-4466-b035-073a858cfd39?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3055971 May 25 15:43:03.843453 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56296d4c-3f26-4c4a-82c9-91fb5fcf604f req-a71c92d4-72a7-47ff-b21e-3931e1fdbf39 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.844904 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-56296d4c-3f26-4c4a-82c9-91fb5fcf604f req-a71c92d4-72a7-47ff-b21e-3931e1fdbf39 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 944 time: 0.1289210 May 25 15:43:03.896327 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-56296d4c-3f26-4c4a-82c9-91fb5fcf604f req-9e995dae-6557-4ec1-9398-51fb01a78fbe tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455229 May 25 15:43:04.331092 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:04.376149 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:04.534507 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b69cfc-afc6-4a06-8ecf-8c8633856e3b req-bc4c1c85-5f9a-4df7-9d0a-af2f42b49938 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.536431 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a1b69cfc-afc6-4a06-8ecf-8c8633856e3b req-bc4c1c85-5f9a-4df7-9d0a-af2f42b49938 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 947 time: 0.1203051 May 25 15:43:04.584577 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['fff1b5a9-eacd-47e1-8a7e-666b346d4163'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:04.585835 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a1b69cfc-afc6-4a06-8ecf-8c8633856e3b req-a4a6b39c-f18e-4adc-bbd7-c4fe19a458a2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430214 May 25 15:43:04.673244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5c6eae-72ae-464d-983e-a5f0ad530394 req-a99ba5dc-aaa0-425b-92c1-d7142f62b051 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.675064 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0a5c6eae-72ae-464d-983e-a5f0ad530394 req-a99ba5dc-aaa0-425b-92c1-d7142f62b051 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0879703 May 25 15:43:04.723129 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0a5c6eae-72ae-464d-983e-a5f0ad530394 req-845730f9-861e-4c52-8062-4b8f8e18c602 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401659 May 25 15:43:05.101269 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26ac9cb-c2b2-4caf-bdba-164a4da84d22 req-c1ca8052-ac2a-43ec-89e7-6a977911d065 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.102883 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c26ac9cb-c2b2-4caf-bdba-164a4da84d22 req-c1ca8052-ac2a-43ec-89e7-6a977911d065 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 944 time: 0.0939922 May 25 15:43:05.152627 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c26ac9cb-c2b2-4caf-bdba-164a4da84d22 req-a715ca70-9d9c-41e2-9a4f-3bfb557fb638 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430100 May 25 15:43:05.332581 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56912) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:05.348596 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 91fd6866-2658-4226-ac3b-718c3cc2a0e4 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:43:05.462061 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.484856 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:05.485080 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:05.488830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Usage tracker for resource:security_group_rule and tenant:6562958a1ffe4399b7575155e3329d25 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:05.492478 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:05.498445 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'network_id': 'b9eb3a46-b38b-4466-b035-073a858cfd39', 'port_id': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'mac_address': 'fa:16:3e:dd:21:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 810, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dbd03780-5c02-4fbd-82c5-313c0ebd02fc', 'ip_address': '192.168.233.76'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:43:05.498621 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:05.557016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.573427 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 91fd6866-2658-4226-ac3b-718c3cc2a0e4 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:05.586142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.590470 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.592720 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:05.596323 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.598159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.599538 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-24f53ee5-e233-4b29-84c2-9d77502c8651 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.647433 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6562958a1ffe4399b7575155e3329d25&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3105559 May 25 15:43:05.647917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56920) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:05.649618 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b29c3b8a-1b48-4eb4-9c6f-a856a8476383,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:05.656317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.671356 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:05.674871 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.720643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.750348 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.806651 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5335ad0f-98d6-4f89-a0d0-0b19bda138a5 req-e4e0edd8-1b64-44d0-aa47-1ab74cce175d tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.808303 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5335ad0f-98d6-4f89-a0d0-0b19bda138a5 req-e4e0edd8-1b64-44d0-aa47-1ab74cce175d tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 948 time: 0.0955737 May 25 15:43:05.898109 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.905033 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-902de5f0-1f38-4604-bfa5-7d32882fc3da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.909567 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5335ad0f-98d6-4f89-a0d0-0b19bda138a5 req-d4526cec-0ce7-4c0d-972b-ca704922ae0c tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950856 May 25 15:43:05.919190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b29c3b8a-1b48-4eb4-9c6f-a856a8476383,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:05.921310 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.925391 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b29c3b8a-1b48-4eb4-9c6f-a856a8476383 HTTP/1.1" status: 204 len: 168 time: 0.2797208 May 25 15:43:05.926739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.977992 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f37eb23-cfaa-4a96-a86b-476b7c49d4a0 req-dbae9ce6-e21a-422d-8a1a-dd66c0fa1ed5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.987912 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2f37eb23-cfaa-4a96-a86b-476b7c49d4a0 req-dbae9ce6-e21a-422d-8a1a-dd66c0fa1ed5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1364553 May 25 15:43:06.032219 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2f37eb23-cfaa-4a96-a86b-476b7c49d4a0 req-977a0292-47c4-475c-86bf-4ebee210e54f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424526 May 25 15:43:06.229297 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56938) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:06.249766 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.266102 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:06.270912 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Usage tracker for resource:security_group_rule and tenant:0e8d84488c8a481992837e691d126e52 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:06.274111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:06.281040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:06.368898 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.374161 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.383051 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a6b5e943-304c-456d-a68e-a781613d1cb5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.386194 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97be5b1-780a-4807-8a73-09825ebd17ba req-31355fc2-3f79-4412-b0dc-617a244f3ad8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:06.387763 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e97be5b1-780a-4807-8a73-09825ebd17ba req-31355fc2-3f79-4412-b0dc-617a244f3ad8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 944 time: 0.0979106 May 25 15:43:06.422664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83c8267c-8971-435e-99e2-fc5cb99e6a46,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:06.428103 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0e8d84488c8a481992837e691d126e52&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1980743 May 25 15:43:06.429696 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.430168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56942) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:06.433490 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e97be5b1-780a-4807-8a73-09825ebd17ba req-c5caa5ec-b373-4872-81cb-12e33e0e00b5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397604 May 25 15:43:06.496204 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.521709 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.576646 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.580572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a949c162-29ab-4cf5-a089-c7cffc80a913 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.591611 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83c8267c-8971-435e-99e2-fc5cb99e6a46,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:06.593856 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.600016 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.601102 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/83c8267c-8971-435e-99e2-fc5cb99e6a46 HTTP/1.1" status: 204 len: 168 time: 0.1699047 May 25 15:43:06.693031 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['91fd6866-2658-4226-ac3b-718c3cc2a0e4'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:07.129771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d2602e-d522-4be9-95c5-8f032012adae req-558c0028-82fb-4f06-99b2-a573c9629480 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.132072 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7d2602e-d522-4be9-95c5-8f032012adae req-558c0028-82fb-4f06-99b2-a573c9629480 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 948 time: 0.0882256 May 25 15:43:07.229327 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7d2602e-d522-4be9-95c5-8f032012adae req-c664b093-6814-4f03-84c7-c2116dffb273 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915120 May 25 15:43:07.262366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111fbde6-bd3c-4da1-b294-6d059498555b req-0c0b6c70-17d3-4778-936b-222ce5c1afab tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.264433 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-111fbde6-bd3c-4da1-b294-6d059498555b req-0c0b6c70-17d3-4778-936b-222ce5c1afab tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1052866 May 25 15:43:07.314897 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-111fbde6-bd3c-4da1-b294-6d059498555b req-1ef36b8e-e882-4eb8-9b14-7a2c3e1d22c0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446684 May 25 15:43:07.632865 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf26bd85-def8-4b30-9016-731f0ab92ae2 req-dedef740-af2c-4d50-86d3-61c7613ada02 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.634357 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bf26bd85-def8-4b30-9016-731f0ab92ae2 req-dedef740-af2c-4d50-86d3-61c7613ada02 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 944 time: 0.0909145 May 25 15:43:07.682154 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bf26bd85-def8-4b30-9016-731f0ab92ae2 req-ebf23c5b-b0a6-4269-9405-2f721f27d1c4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414104 May 25 15:43:08.611648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d36e6b1-353e-461d-8908-abf1819bbc33 req-57618465-7a3b-4258-8ec0-d5692fe3dfcc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.613224 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5d36e6b1-353e-461d-8908-abf1819bbc33 req-57618465-7a3b-4258-8ec0-d5692fe3dfcc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1774790 May 25 15:43:08.626709 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730431d8-2f30-4b21-9974-b63138768ee1 req-f4a462ec-0dfb-4e2a-9a39-cda662f3d0f0 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.628859 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-730431d8-2f30-4b21-9974-b63138768ee1 req-f4a462ec-0dfb-4e2a-9a39-cda662f3d0f0 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 948 time: 0.1170771 May 25 15:43:08.700851 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5d36e6b1-353e-461d-8908-abf1819bbc33 req-4c567413-e172-44ce-8cf6-7d0ae7479da3 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716648 May 25 15:43:08.705863 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-730431d8-2f30-4b21-9974-b63138768ee1 req-fce8e921-4436-4674-8309-8bd377ec3c3d tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626690 May 25 15:43:08.874909 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38111b4c-8ab7-4b29-8caf-3347c13150b8 req-b5ea7b1e-bc3a-4543-bc2f-dbaf6279cd8f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.876371 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-38111b4c-8ab7-4b29-8caf-3347c13150b8 req-b5ea7b1e-bc3a-4543-bc2f-dbaf6279cd8f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 944 time: 0.0801213 May 25 15:43:08.921008 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-38111b4c-8ab7-4b29-8caf-3347c13150b8 req-b3323017-6fab-46c8-a737-68da5c852411 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390236 May 25 15:43:09.372089 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 91fd6866-2658-4226-ac3b-718c3cc2a0e4 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:43:09.442214 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:43:09.447144 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:09.447529 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.569913 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.599793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:09.611225 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:09.614845 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.615741 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fff1b5a9-eacd-47e1-8a7e-666b346d4163 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:43:09.645287 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:09.677531 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'code': 200} May 25 15:43:09.746400 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:09.761825 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:09.772090 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port fff1b5a9-eacd-47e1-8a7e-666b346d4163 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:43:09.777330 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port fff1b5a9-eacd-47e1-8a7e-666b346d4163 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:09.777655 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.937208 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.972728 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:09.977177 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:09.979209 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.072310 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:10.075686 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.124195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ba1a0b-b54e-4547-b900-760ac3d5b4e4 req-5c75b90a-4759-499c-ba98-758638031352 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.125616 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-99ba1a0b-b54e-4547-b900-760ac3d5b4e4 req-5c75b90a-4759-499c-ba98-758638031352 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2308266 May 25 15:43:10.137436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3da41f-6b44-49d8-81e9-4f71d80f8b8a req-965fd314-6581-4090-ae25-4e22a797ddb8 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.138791 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0d3da41f-6b44-49d8-81e9-4f71d80f8b8a req-965fd314-6581-4090-ae25-4e22a797ddb8 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.2099128 May 25 15:43:10.142911 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5afdb88a-239d-4779-843f-479a9328d50b req-33b24afc-f85e-4929-aa7c-b438aaf51a55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.144218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5afdb88a-239d-4779-843f-479a9328d50b req-33b24afc-f85e-4929-aa7c-b438aaf51a55 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 1102 time: 0.1458991 May 25 15:43:10.292277 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5afdb88a-239d-4779-843f-479a9328d50b req-1c0cdc73-18da-443e-971b-c653446c0509 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777311 May 25 15:43:10.300871 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-99ba1a0b-b54e-4547-b900-760ac3d5b4e4 req-c48411be-91b7-4c82-b533-3800bbd970ac tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1611168 May 25 15:43:10.304182 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0d3da41f-6b44-49d8-81e9-4f71d80f8b8a req-2b51f2ef-5434-4124-b347-06569fe3127a tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1583283 May 25 15:43:10.487277 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65aaa30d-90f2-45a4-8fc8-f3e21bb342a5 req-547350f1-8847-4401-a883-7362809fb3db tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.488754 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-65aaa30d-90f2-45a4-8fc8-f3e21bb342a5 req-547350f1-8847-4401-a883-7362809fb3db tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0836780 May 25 15:43:10.532326 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-65aaa30d-90f2-45a4-8fc8-f3e21bb342a5 req-5433fdaa-0294-491f-bef3-1478766365a0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379267 May 25 15:43:11.679228 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:15.666192 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cca124c-9e26-4099-89bc-9ceb8b0d0e15 req-f32e8516-40d2-4e26-bdcc-805fbfc8de5c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.667710 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6cca124c-9e26-4099-89bc-9ceb8b0d0e15 req-f32e8516-40d2-4e26-bdcc-805fbfc8de5c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0826776 May 25 15:43:15.762186 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6cca124c-9e26-4099-89bc-9ceb8b0d0e15 req-d30d8eb3-5cef-4576-93c4-9b0d350c2ba9 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882087 May 25 15:43:15.795313 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9820ae-bf5f-47d1-bc8e-542062fed686 req-ae52afbd-d30c-4067-8a8e-6e2868780f35 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.797292 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca9820ae-bf5f-47d1-bc8e-542062fed686 req-ae52afbd-d30c-4067-8a8e-6e2868780f35 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0924380 May 25 15:43:15.847132 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca9820ae-bf5f-47d1-bc8e-542062fed686 req-af13a16f-60cc-405a-88d3-7a3ca25e5d47 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429895 May 25 15:43:15.899736 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'code': 200} May 25 15:43:15.946932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f86fe6-6560-4c5a-8f0d-94d0aaa0b4c8 req-71419002-6d03-4f1e-bbb0-d1aa88612f34 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.948448 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f1f86fe6-6560-4c5a-8f0d-94d0aaa0b4c8 req-71419002-6d03-4f1e-bbb0-d1aa88612f34 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0811205 May 25 15:43:15.993079 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f1f86fe6-6560-4c5a-8f0d-94d0aaa0b4c8 req-474ebaca-87d6-47b4-8670-dabba4eaf7f7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389760 May 25 15:43:16.295106 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba454d3-65d2-4f46-825d-a73d55bf9edd req-09d48c71-b92c-4be1-b393-2c4b1e416562 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.297214 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eba454d3-65d2-4f46-825d-a73d55bf9edd req-09d48c71-b92c-4be1-b393-2c4b1e416562 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1098 time: 0.0702047 May 25 15:43:16.353218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eba454d3-65d2-4f46-825d-a73d55bf9edd req-5d3d27e1-34aa-4045-b4f0-a0fafec39519 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405207 May 25 15:43:17.345948 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e8d270-09f3-4928-a5ab-f5b613f08669 req-990aa303-b620-4b35-9712-1b4ef25b0612 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.347379 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b1e8d270-09f3-4928-a5ab-f5b613f08669 req-990aa303-b620-4b35-9712-1b4ef25b0612 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1465542 May 25 15:43:17.374457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d7e5108-11a3-4179-9cf0-e6e7cd383fc4 req-567b8407-3f67-4356-b153-1d01b79d7655 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.375833 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8d7e5108-11a3-4179-9cf0-e6e7cd383fc4 req-567b8407-3f67-4356-b153-1d01b79d7655 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.1235206 May 25 15:43:17.432366 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b1e8d270-09f3-4928-a5ab-f5b613f08669 req-ef7ed5b7-726f-4af0-b4c0-ba6b25433634 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773051 May 25 15:43:17.442343 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8d7e5108-11a3-4179-9cf0-e6e7cd383fc4 req-085d3ef6-3a1f-4202-8110-ec02688ec8ab tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593035 May 25 15:43:17.611543 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7be887c-7d51-4c77-af3f-8e529d61ed3b req-59b2b978-873b-4a0d-a841-22103fe55f64 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.612989 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e7be887c-7d51-4c77-af3f-8e529d61ed3b req-59b2b978-873b-4a0d-a841-22103fe55f64 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0806327 May 25 15:43:17.657203 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e7be887c-7d51-4c77-af3f-8e529d61ed3b req-4548ed91-ed5d-4cce-bae3-aa3061533544 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379641 May 25 15:43:19.423232 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:43:22.576141 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75fc8efb-637d-4365-a1d3-aaed6b27259d req-8ed1f149-a56e-4ff6-abcb-e5d56bee9cd8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:22.577609 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-75fc8efb-637d-4365-a1d3-aaed6b27259d req-8ed1f149-a56e-4ff6-abcb-e5d56bee9cd8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0851834 May 25 15:43:22.658730 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-75fc8efb-637d-4365-a1d3-aaed6b27259d req-4c19aee3-e304-4dc5-8c53-1ed0e6bd627e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753448 May 25 15:43:22.702014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67477c81-c2f0-40c9-a579-e57f61c89398 req-ea9efbeb-6e6f-4bd1-a528-5a559c32c8dc tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:22.703411 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67477c81-c2f0-40c9-a579-e57f61c89398 req-ea9efbeb-6e6f-4bd1-a528-5a559c32c8dc tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0927351 May 25 15:43:22.753064 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67477c81-c2f0-40c9-a579-e57f61c89398 req-6880a1b6-e76a-41a9-a2b1-55930124121b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433271 May 25 15:43:22.856739 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9ce9db-9f5a-40ad-9e97-23cf0c27c4aa req-0fa26be4-af2f-4942-932c-c97abe75a1ce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:22.858384 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ed9ce9db-9f5a-40ad-9e97-23cf0c27c4aa req-0fa26be4-af2f-4942-932c-c97abe75a1ce tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0901830 May 25 15:43:22.904501 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ed9ce9db-9f5a-40ad-9e97-23cf0c27c4aa req-54e70079-a85c-488e-be47-224e1096b155 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394919 May 25 15:43:23.903944 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e484161a-9376-4f1b-b9f9-b0a18930024d req-d9051229-2f42-4409-9a19-5f3f0f5b6251 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:23.905366 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e484161a-9376-4f1b-b9f9-b0a18930024d req-d9051229-2f42-4409-9a19-5f3f0f5b6251 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0791378 May 25 15:43:23.983284 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e484161a-9376-4f1b-b9f9-b0a18930024d req-3fb74d01-2c41-4c35-93ed-8223dfc0f6da tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721242 May 25 15:43:24.033308 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64960456-a9b8-43cb-b2b1-ad0c0e1cca71 req-737814c9-070a-4006-bcfc-d9b6bac5c4a2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.034737 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-64960456-a9b8-43cb-b2b1-ad0c0e1cca71 req-737814c9-070a-4006-bcfc-d9b6bac5c4a2 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0862684 May 25 15:43:24.130275 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-64960456-a9b8-43cb-b2b1-ad0c0e1cca71 req-ad60cfea-a723-47e5-8516-1f27e915adff tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894346 May 25 15:43:24.176010 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88a3edc-118d-4a6e-963c-2f7a54babb24 req-605f96b6-56ad-46ea-80a1-e8ebbe7a3545 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.177938 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f88a3edc-118d-4a6e-963c-2f7a54babb24 req-605f96b6-56ad-46ea-80a1-e8ebbe7a3545 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0948482 May 25 15:43:24.224381 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f88a3edc-118d-4a6e-963c-2f7a54babb24 req-5aa4b86f-7f45-44f0-8dbf-cea16e20fc3e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401297 May 25 15:43:24.642597 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b77a6a-9eca-4653-9264-877ffee4849c req-ac34a348-48cd-4b81-b884-a2077c6063d3 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.644262 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-24b77a6a-9eca-4653-9264-877ffee4849c req-ac34a348-48cd-4b81-b884-a2077c6063d3 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0976880 May 25 15:43:24.690930 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-24b77a6a-9eca-4653-9264-877ffee4849c req-e6e6b485-6872-460e-9b33-3eb9265efac9 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408287 May 25 15:43:25.187579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a5f34f-4190-4f4b-ba40-885122882805 req-c5ba43e9-5550-4cb7-a673-07e69ebe00d2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.188885 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-69a5f34f-4190-4f4b-ba40-885122882805 req-c5ba43e9-5550-4cb7-a673-07e69ebe00d2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0874953 May 25 15:43:25.234894 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-69a5f34f-4190-4f4b-ba40-885122882805 req-e170b1c2-69ce-4c28-9e01-824c33f5ec27 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401392 May 25 15:43:25.409522 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acfac8f-3b84-4a65-a17e-2c18e66a8cbc req-fa2ea8ea-a245-4f67-b97f-e04cb5d13cfc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.411007 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1acfac8f-3b84-4a65-a17e-2c18e66a8cbc req-fa2ea8ea-a245-4f67-b97f-e04cb5d13cfc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0795712 May 25 15:43:25.511053 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1acfac8f-3b84-4a65-a17e-2c18e66a8cbc req-80d7c0c3-2f7e-4fab-a807-fa4ba22b03a1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942895 May 25 15:43:25.969698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0228bc6-67ef-4bd6-86fd-5a40571b1306 req-24538a64-6979-45d6-a945-0fa95256da00 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.971536 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b0228bc6-67ef-4bd6-86fd-5a40571b1306 req-24538a64-6979-45d6-a945-0fa95256da00 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.1122820 May 25 15:43:26.031190 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b0228bc6-67ef-4bd6-86fd-5a40571b1306 req-28184610-60de-46f7-addb-328dc73c5526 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496218 May 25 15:43:29.104048 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-18006f55-560f-438f-b623-010c45bcb3d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:30.388110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7503de0-e84d-472c-9311-e3f1bae506b5 req-ec195e1b-f042-4538-97c1-d5ba70503ad8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.389570 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7503de0-e84d-472c-9311-e3f1bae506b5 req-ec195e1b-f042-4538-97c1-d5ba70503ad8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0920956 May 25 15:43:30.481439 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7503de0-e84d-472c-9311-e3f1bae506b5 req-4ae68dab-306d-46bd-b802-d61ef456081f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551891 May 25 15:43:30.509395 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304a1c7a-7b78-4afc-98a3-f766bc07e956 req-af6e8957-b100-4597-963f-daaad3aacdff tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.510822 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-304a1c7a-7b78-4afc-98a3-f766bc07e956 req-af6e8957-b100-4597-963f-daaad3aacdff tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.1201797 May 25 15:43:30.558660 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-304a1c7a-7b78-4afc-98a3-f766bc07e956 req-dae95397-c2c5-4dfa-a491-80ed024ede2f tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415421 May 25 15:43:31.506341 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:31.673401 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-47a2706c-beea-423a-8fb3-84f184891de5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:31.905376 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e881fe74-5d98-4c7e-b67d-9436bdd8e42c req-cf1a96be-4494-4805-82f6-9119d12b7c44 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:31.907340 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e881fe74-5d98-4c7e-b67d-9436bdd8e42c req-cf1a96be-4494-4805-82f6-9119d12b7c44 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0812471 May 25 15:43:31.951819 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e881fe74-5d98-4c7e-b67d-9436bdd8e42c req-c8b737d8-f685-46eb-8f8f-470830ea647f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387390 May 25 15:43:32.162913 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a6ee90-2edb-4428-8687-f370f8a9a1d5 req-681fca90-8330-437a-9fb0-182600f3e257 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:32.164406 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d6a6ee90-2edb-4428-8687-f370f8a9a1d5 req-681fca90-8330-437a-9fb0-182600f3e257 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0943668 May 25 15:43:32.228438 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d6a6ee90-2edb-4428-8687-f370f8a9a1d5 req-0baa931c-475d-4050-bb87-42af76eeff69 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545681 May 25 15:43:32.665193 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:33.162832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f84f6b-9364-48d1-be8a-71ae326cf39b req-037e8d3e-2fce-4341-95a6-a0c81e6de6a2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.164292 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-58f84f6b-9364-48d1-be8a-71ae326cf39b req-037e8d3e-2fce-4341-95a6-a0c81e6de6a2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0786042 May 25 15:43:33.208989 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-58f84f6b-9364-48d1-be8a-71ae326cf39b req-48e15769-bf84-45a4-846f-70466f1ddb96 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390232 May 25 15:43:33.439771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139a5728-4ecf-4cb4-a6a2-26ca0c8ca902 req-b917a0ff-2d56-4924-aff8-47bc253f6658 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.441791 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-139a5728-4ecf-4cb4-a6a2-26ca0c8ca902 req-b917a0ff-2d56-4924-aff8-47bc253f6658 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0932977 May 25 15:43:33.514126 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-139a5728-4ecf-4cb4-a6a2-26ca0c8ca902 req-a0689a78-db03-4f58-a92f-d622cfaf3b68 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651879 May 25 15:43:34.345377 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:34.377945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:34.417815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34036929-c784-40e5-bc5d-514cb83ca7ec req-20031c85-a930-4894-879c-c284b66eaacc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.419419 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-34036929-c784-40e5-bc5d-514cb83ca7ec req-20031c85-a930-4894-879c-c284b66eaacc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0949538 May 25 15:43:34.477195 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-34036929-c784-40e5-bc5d-514cb83ca7ec req-afdfba13-3143-46c1-98cb-48ed952a64aa tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511181 May 25 15:43:38.435480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77c3956-7e69-423e-9e32-6cf545681313 req-9849d31f-d473-4721-b633-3a5de112b0ce tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.437707 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d77c3956-7e69-423e-9e32-6cf545681313 req-9849d31f-d473-4721-b633-3a5de112b0ce tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.74 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.0851393 May 25 15:43:38.702179 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 91fd6866-2658-4226-ac3b-718c3cc2a0e4 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:43:38.738451 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-a8685283-9ac5-4026-a39b-c0feeba824fb service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0913324 May 25 15:43:38.790281 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ef8ea3-d4a3-44e0-9ad0-f4595fe3ec8e req-da34a6b3-93c1-4777-a4c8-c4d7bba170b4 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.790979 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-38ef8ea3-d4a3-44e0-9ad0-f4595fe3ec8e req-da34a6b3-93c1-4777-a4c8-c4d7bba170b4 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 949 time: 0.2794201 May 25 15:43:38.839351 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Deleting port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:43:38.839782 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.871079 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e538c9f3-6d76-4a79-a1cf-a4db65389a5e req-1187f3d8-1ede-42cf-84b5-dee8df88e3ea tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.872543 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e538c9f3-6d76-4a79-a1cf-a4db65389a5e req-1187f3d8-1ede-42cf-84b5-dee8df88e3ea tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.2278202 May 25 15:43:38.887616 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.932395 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:38.943828 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:38.950347 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.952022 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-97332263-cd9f-458b-ad84-27e343969e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.952472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.956353 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-97332263-cd9f-458b-ad84-27e343969e26 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.1372778 May 25 15:43:38.961496 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-38ef8ea3-d4a3-44e0-9ad0-f4595fe3ec8e req-60b6abbc-dfb7-434a-9571-e5d23a3bd3ae tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/security-groups?id=df8965eb-a4a2-4197-a460-624892238884&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1606519 May 25 15:43:39.040147 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=6']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:39.043872 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.092953 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'code': 200} May 25 15:43:39.114971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] For port 91fd6866-2658-4226-ac3b-718c3cc2a0e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=91fd6866-2658-4226-ac3b-718c3cc2a0e4,segment=NetworkSegment(e59bb930-6f45-4068-949e-e382d6e561f0),segment_id=e59bb930-6f45-4068-949e-e382d6e561f0)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:39.115329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:39.132611 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e538c9f3-6d76-4a79-a1cf-a4db65389a5e req-5a653534-56fc-4e7b-8b17-4be908150354 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2011740 May 25 15:43:39.203747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-89df20fa-f295-4c30-b760-0556ac61de01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.205505 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-89df20fa-f295-4c30-b760-0556ac61de01 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.2149880 May 25 15:43:39.250402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Calling delete_port for 91fd6866-2658-4226-ac3b-718c3cc2a0e4 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:43:39.303961 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-822ffea5-91bb-4111-b702-08b8bc792571 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.0839658 May 25 15:43:39.398083 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:39.408135 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbb42622-f513-423f-9854-ed8342821b46 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.416397 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-2856f055-eb0b-4e65-b47c-93bfa7957988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.418658 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-2856f055-eb0b-4e65-b47c-93bfa7957988 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0977445 May 25 15:43:39.460468 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Pushing event deleted for resources: {'Port': ['ID=91fd6866-2658-4226-ac3b-718c3cc2a0e4,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:39.478630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.479042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.479396 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.479770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.480184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.480530 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.480870 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.481242 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.481630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.482023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.482362 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.482743 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:39.532737 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-41063b63-c018-41ae-9d5a-5695f8dec1b6 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0954134 May 25 15:43:39.658252 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.696552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] No DVR routers for this DVR port 91fd6866-2658-4226-ac3b-718c3cc2a0e4 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:43:39.699162 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:39.704321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-deleted', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:39.732636 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d77c3956-7e69-423e-9e32-6cf545681313 req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.74 "DELETE /v2.0/ports/91fd6866-2658-4226-ac3b-718c3cc2a0e4 HTTP/1.1" status: 204 len: 173 time: 1.1601992 May 25 15:43:39.761699 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95555d56-393e-4997-95ac-a3e530ab54a9', 'name': 'network-vif-deleted', 'tag': '91fd6866-2658-4226-ac3b-718c3cc2a0e4', 'status': 'completed', 'code': 200} May 25 15:43:39.763485 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-72642d91-9fcf-4e49-9570-e38d2c2a0c1d service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1602957 May 25 15:43:40.019875 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-c6ea1053-6544-4b22-8809-ee4bda4adb67 req-19186abe-f4fa-4ba9-99fa-6677700b6ca2 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1367302 May 25 15:43:40.166841 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-02318cbe-a6c0-4f22-bf52-8875e5897b4c req-7f6d1394-f8b6-4a88-8fc6-32e92294d745 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Synchronizing usage tracker for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:40.184498 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-02318cbe-a6c0-4f22-bf52-8875e5897b4c req-7f6d1394-f8b6-4a88-8fc6-32e92294d745 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Unset dirty status for tenant:f21f28becb8940c78e4bf7cf3035f950 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:40.185955 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-02318cbe-a6c0-4f22-bf52-8875e5897b4c req-7f6d1394-f8b6-4a88-8fc6-32e92294d745 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 210 time: 0.0631812 May 25 15:43:40.355754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabbf4d0-df5d-480d-9228-5e0cf052b29d req-53f73cd5-5ffe-4dd5-b868-719f0c7cb44a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.357239 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aabbf4d0-df5d-480d-9228-5e0cf052b29d req-53f73cd5-5ffe-4dd5-b868-719f0c7cb44a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0851557 May 25 15:43:40.406502 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aabbf4d0-df5d-480d-9228-5e0cf052b29d req-9be762ed-c0db-4a47-a1c3-2e4badec5dd5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389509 May 25 15:43:41.401858 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bc49e5ea-a5cf-4111-8db1-1fb9dca5ff67 req-61c91018-fa7a-4745-9e01-a58995facd5b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] 10.222.0.25 "GET /v2.0/ports?device_id=95555d56-393e-4997-95ac-a3e530ab54a9 HTTP/1.1" status: 200 len: 210 time: 0.0485594 May 25 15:43:41.602714 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fee4d73-ce67-48f0-9ca3-cd9bd36e0afb req-50fc5211-1d84-43c4-8f44-943f0904a193 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.604125 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2fee4d73-ce67-48f0-9ca3-cd9bd36e0afb req-50fc5211-1d84-43c4-8f44-943f0904a193 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0800829 May 25 15:43:41.650532 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2fee4d73-ce67-48f0-9ca3-cd9bd36e0afb req-2be78a4d-417a-46e9-9eee-d6c363b3cee2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405495 May 25 15:43:41.889390 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7072e10a-7671-4900-9c55-3c793a8aaf60 req-e2ea86d2-19ca-439a-a0b5-e50ed468b9c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.891954 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7072e10a-7671-4900-9c55-3c793a8aaf60 req-e2ea86d2-19ca-439a-a0b5-e50ed468b9c9 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.0820608 May 25 15:43:41.939824 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7072e10a-7671-4900-9c55-3c793a8aaf60 req-45ee02fb-6093-4b0a-9470-c4cf9efef252 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387895 May 25 15:43:47.866753 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ac6303-33d3-45da-beaf-e651b9303591 req-83ee1ef3-8f06-42c5-b7c7-9ed71fb17402 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.868477 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09ac6303-33d3-45da-beaf-e651b9303591 req-83ee1ef3-8f06-42c5-b7c7-9ed71fb17402 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.0888445 May 25 15:43:47.919834 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09ac6303-33d3-45da-beaf-e651b9303591 req-0fcc18c8-2474-4663-9705-8769a477ab3f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418818 May 25 15:43:49.161531 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdc4bc9-d5c7-48f4-9fd6-ec070df453cc req-4b3259b5-d883-41a1-82b6-f9c06c1b5082 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:49.171454 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7cdc4bc9-d5c7-48f4-9fd6-ec070df453cc req-4b3259b5-d883-41a1-82b6-f9c06c1b5082 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1022372 May 25 15:43:49.234451 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7cdc4bc9-d5c7-48f4-9fd6-ec070df453cc req-82c1b60f-71da-4b71-9c2e-be9e820cdb48 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611374 May 25 15:43:50.527787 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb91390d-1302-4a43-a54c-1ed918198cb2 req-558d525c-e086-4d27-a44e-c62c26924131 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:50.529656 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eb91390d-1302-4a43-a54c-1ed918198cb2 req-558d525c-e086-4d27-a44e-c62c26924131 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1622975 May 25 15:43:50.580875 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eb91390d-1302-4a43-a54c-1ed918198cb2 req-11902c25-9e87-4f6e-80fe-0d47aa1bd293 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442896 May 25 15:43:50.810353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066aa056-5e63-42fb-b473-f6b10dc80faa req-4824a25f-d636-499d-a44b-dba84dceede5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:50.812512 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-066aa056-5e63-42fb-b473-f6b10dc80faa req-4824a25f-d636-499d-a44b-dba84dceede5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1157160 May 25 15:43:50.866181 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-066aa056-5e63-42fb-b473-f6b10dc80faa req-028bd87f-8369-4d0f-a7b3-39d6d07b7053 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468507 May 25 15:43:53.377734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42196a76-d01a-4a6c-b03b-672075634047 req-a05f855d-345a-44ef-bd9c-b69df021105e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.379154 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-42196a76-d01a-4a6c-b03b-672075634047 req-a05f855d-345a-44ef-bd9c-b69df021105e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0838275 May 25 15:43:53.424924 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-42196a76-d01a-4a6c-b03b-672075634047 req-75e319d3-68d4-4198-a2be-b2d80e749f36 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395153 May 25 15:43:53.495410 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-e9c53066-a46c-4a3c-9605-8306e05bb60b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.497754 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-e9c53066-a46c-4a3c-9605-8306e05bb60b service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.0768914 May 25 15:43:53.648361 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-ad02ebd5-1a54-4c05-910e-5fc539e1fa0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.649780 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-ad02ebd5-1a54-4c05-910e-5fc539e1fa0b service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1266732 May 25 15:43:53.746531 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-8cf46057-01a2-4c5b-92ac-cc9d1a738bec service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.0688012 May 25 15:43:53.818231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-1071b348-0ea1-46ce-a7c7-c7ddfe75381e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.819645 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-1071b348-0ea1-46ce-a7c7-c7ddfe75381e service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0563197 May 25 15:43:53.881773 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-973d3388-b821-4f3e-ba35-18f640eb4b4a service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0443506 May 25 15:43:54.110782 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-66114d9b-6abf-49d6-9b96-6a10fd56f219 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2087076 May 25 15:43:54.291999 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-80d8eaff-1f7e-4bc1-9538-63060bd3f5c4 req-66cfd7b7-15dd-455e-9c67-a0c2c4567db7 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1342118 May 25 15:43:54.632682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ea7738-1eea-4cd4-b534-5d64915f6ffe req-d3e89398-d33f-4ba2-b30d-833bd8da6ef8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:54.634123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03ea7738-1eea-4cd4-b534-5d64915f6ffe req-d3e89398-d33f-4ba2-b30d-833bd8da6ef8 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0818388 May 25 15:43:54.686332 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03ea7738-1eea-4cd4-b534-5d64915f6ffe req-5298c275-1f24-499c-94ab-07ff6129adf9 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424769 May 25 15:43:55.230215 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 57890) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:55.357965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.373178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:55.376932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Usage tracker for resource:security_group_rule and tenant:ea0e49ca957a420ca0bfb6b8802951f9 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:55.379694 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:55.385195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:55.469780 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.474257 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.482352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5de59158-f802-46d9-890e-967f9c538a5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.522747 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ea0e49ca957a420ca0bfb6b8802951f9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2912631 May 25 15:43:55.523646 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c45f4a5-de6e-40ec-9ebe-134e2605cdea,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:55.525673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 57898) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:55.526961 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.586690 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.615034 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.677334 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.684980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ebdce59b-fafd-4110-aa9f-81defa3ca2e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.699413 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c45f4a5-de6e-40ec-9ebe-134e2605cdea,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:55.712979 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.712979 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.713448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.713964 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.714422 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.714888 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.715583 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.716061 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.716512 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.717038 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.717831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.719591 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:55.724770 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.725402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:55.726980 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5c45f4a5-de6e-40ec-9ebe-134e2605cdea HTTP/1.1" status: 204 len: 168 time: 0.1999154 May 25 15:43:55.927189 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa2cf0c-5a8a-48f4-a990-bd101ad079d5 req-e0c03fc5-b8a1-4e80-8325-5a1d6c26c82e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:55.928775 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8fa2cf0c-5a8a-48f4-a990-bd101ad079d5 req-e0c03fc5-b8a1-4e80-8325-5a1d6c26c82e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0924702 May 25 15:43:55.978655 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8fa2cf0c-5a8a-48f4-a990-bd101ad079d5 req-9ee70e97-2454-4239-8606-9335de017856 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400021 May 25 15:43:56.078140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 57912) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:56.096279 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.111406 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:56.115194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Usage tracker for resource:security_group_rule and tenant:f7947d13570c4e9787c7a9898c517de0 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:56.118039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:56.124044 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:56.219080 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.226585 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.236454 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cd07585f-cd67-4241-875a-4f3d810fd0cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.276708 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f7947d13570c4e9787c7a9898c517de0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1974623 May 25 15:43:56.279327 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 57922) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:56.294799 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80c2f15d-a514-45d4-81d3-24542dd577d2,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:56.301476 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.365204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.396936 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.423590 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:43:56.456889 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.461336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c1a430d6-4ff2-4380-8023-0bf537e7061d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.476311 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80c2f15d-a514-45d4-81d3-24542dd577d2,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:56.481518 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.485579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:56.489490 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/80c2f15d-a514-45d4-81d3-24542dd577d2 HTTP/1.1" status: 204 len: 168 time: 0.2091115 May 25 15:43:56.717087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 57948) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:56.723272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-ddf164ba-7f45-4649-9084-5edb3a399731 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:56.724939 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-ddf164ba-7f45-4649-9084-5edb3a399731 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1798329 May 25 15:43:56.745538 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-5d221c30-6f88-4992-88a6-2e23b50a9837 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/quotas/fe662b5dcc2c4a1da1aa9473bd7e9dd7 HTTP/1.1" status: 200 len: 375 time: 0.0113139 May 25 15:43:56.854152 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-e5ce1575-b57b-4221-be5d-e7cd316ca7a9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1030543 May 25 15:43:56.937893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 57964) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:56.938546 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-18351d54-795e-4e7a-a3b2-56553250635c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f21f28becb8940c78e4bf7cf3035f950&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2173197 May 25 15:43:57.045640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-3b384645-8760-4e4b-877f-376da141a684 service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1834810 May 25 15:43:57.048222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:57.245806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:57.362862 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-52648ea9-c072-4137-9a2c-c004378beddd service neutron] 10.222.0.25 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3048310 May 25 15:43:57.379001 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c9fb76-d0f2-44ea-8e37-410ccd387dbe req-1442f406-8b42-4a84-82ec-43104f02bc57 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:57.380598 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-17c9fb76-d0f2-44ea-8e37-410ccd387dbe req-1442f406-8b42-4a84-82ec-43104f02bc57 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1725850 May 25 15:43:57.387125 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:57.394916 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:57.424574 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df8965eb-a4a2-4197-a460-624892238884,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:57.429364 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:57.449247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:57.452909 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/df8965eb-a4a2-4197-a460-624892238884 HTTP/1.1" status: 204 len: 168 time: 0.5115125 May 25 15:43:57.469363 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-17c9fb76-d0f2-44ea-8e37-410ccd387dbe req-ab082c3a-f9ac-49d5-9c2e-defeb60484cc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752790 May 25 15:43:57.674082 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79a972bf-9eae-430c-8e70-4c1ab14f5d5c req-22db8701-8833-416f-b058-54c514218738 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0476050 May 25 15:43:58.686108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60045e11-4692-4414-9506-edcdf9f0bd76 req-970aac8c-0bbe-4321-8dda-ff988e17615e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:58.688382 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-60045e11-4692-4414-9506-edcdf9f0bd76 req-970aac8c-0bbe-4321-8dda-ff988e17615e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0879626 May 25 15:43:58.739292 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58050) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:58.744080 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-60045e11-4692-4414-9506-edcdf9f0bd76 req-19289e72-9362-447b-8de4-faa9875236f1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493126 May 25 15:43:58.894872 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0cacd021-0d36-40fc-9801-401380a5fedb req-97a38368-022f-4fae-a245-24991352c2e1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0677900 May 25 15:43:58.949082 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:58.964987 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:58.968813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Usage tracker for resource:security_group_rule and tenant:3e0248ae3647439ebdd38077c84f3afa is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:58.971653 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:58.977313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:59.065668 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.069842 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.083313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6d6e28d2-a7ba-4c88-9cdb-5e1efd3f4fe2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.110723 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d9ccfc82-169a-4b53-8d5f-5337d56b187b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.122501 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3e0248ae3647439ebdd38077c84f3afa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3820910 May 25 15:43:59.126002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58076) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:59.139406 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e95f7388-3e9f-4c40-a61b-38c208235722,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:59.144770 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.188342 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.215913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.276681 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.282087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f8c9e2bb-6438-4824-a4f8-1df8a519ee7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.295800 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e95f7388-3e9f-4c40-a61b-38c208235722,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:59.308559 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.318697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.320777 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e95f7388-3e9f-4c40-a61b-38c208235722 HTTP/1.1" status: 204 len: 168 time: 0.1937997 May 25 15:43:59.674196 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58090) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:59.691677 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.706288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:59.710281 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Usage tracker for resource:security_group_rule and tenant:5049f0bcbe4f4e30a8e2d4b82432d36f is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:59.713262 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:59.719459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:59.811279 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.816155 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:59.839160 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-f199c0f7-2186-47ca-b174-886d03dbc849 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:59.841295 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-f199c0f7-2186-47ca-b174-886d03dbc849 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 815 time: 0.1733589 May 25 15:43:59.844933 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-524e0a11-39c5-445c-91cc-fc423a3bc90f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.867309 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5049f0bcbe4f4e30a8e2d4b82432d36f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1920447 May 25 15:43:59.870358 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58096) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:59.890097 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Request body: {'port': {'device_id': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'admin_state_up': True, 'tenant_id': 'fe662b5dcc2c4a1da1aa9473bd7e9dd7'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:59.912537 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3be85b8e-ba3b-4146-a9fc-cfc50662055d,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:59.914934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.968839 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f183f69e-3b4a-462b-bdfb-faa51efde065 req-23f7db32-bc32-4661-b431-fe8ffb9d462e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:59.970554 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f183f69e-3b4a-462b-bdfb-faa51efde065 req-23f7db32-bc32-4661-b431-fe8ffb9d462e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1021240 May 25 15:44:00.060125 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f183f69e-3b4a-462b-bdfb-faa51efde065 req-d879af48-e9ee-4097-bf5e-a5166f99f839 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766919 May 25 15:44:00.062327 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-418dbcd3-cc06-445a-b20c-1d5aabb3c523 req-e6c578b3-3f76-466f-b769-e43b1b178238 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0509930 May 25 15:44:00.070960 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:00.079357 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Usage tracker for resource:port and tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:00.084875 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:00.100190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:00.108090 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.120351 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Made reservation on behalf of fe662b5dcc2c4a1da1aa9473bd7e9dd7 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:00.123805 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.158848 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.324970 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.331176 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0130d78f-1e4a-421e-a50d-7c6e844491f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.351848 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3be85b8e-ba3b-4146-a9fc-cfc50662055d,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:00.354084 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.369855 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Allocated IP 172.20.0.12 (956d5f61-ae8e-4c95-bd97-6ae439ceff67/bf87cdb0-06e4-4ee0-ad97-e62e40212515/fd471234-c522-4ab5-852b-64ca2a29444b) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:00.387049 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.388527 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3be85b8e-ba3b-4146-a9fc-cfc50662055d HTTP/1.1" status: 204 len: 168 time: 0.5171101 May 25 15:44:00.596232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.643362 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.651233 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.728274 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'fff1b5a9-eacd-47e1-8a7e-666b346d4163'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:44:00.741302 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:00.744683 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:00.750142 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:00.789956 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event updated for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:00.793795 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.831424 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:00.832078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.852406 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9679558 May 25 15:44:00.887156 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Request body: {'port': {'device_id': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:01.026152 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.435741 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d19389d-f6e6-4e45-a781-fa9d9a5133b0 req-c6040bcf-c33b-4f19-9687-a5f217f10881 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:01.437289 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8d19389d-f6e6-4e45-a781-fa9d9a5133b0 req-c6040bcf-c33b-4f19-9687-a5f217f10881 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 932 time: 0.2254150 May 25 15:44:01.489508 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a13bb9-63ad-4ea5-8506-a00772888f65 req-35cb1edb-1d16-4bde-b3c6-7dda59f5c75e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:01.497372 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0a13bb9-63ad-4ea5-8506-a00772888f65 req-35cb1edb-1d16-4bde-b3c6-7dda59f5c75e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1734011 May 25 15:44:01.527422 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.542548 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd471234-c522-4ab5-852b-64ca2a29444b {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:44:01.546703 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8d19389d-f6e6-4e45-a781-fa9d9a5133b0 req-dde044a9-b4a3-4647-a08c-29a3713d67bb tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006060 May 25 15:44:01.551699 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.573972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Transition to ACTIVE for port object fd471234-c522-4ab5-852b-64ca2a29444b will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:01.575290 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0a13bb9-63ad-4ea5-8506-a00772888f65 req-46434b5d-b494-4b9e-b488-d2beeefef061 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770054 May 25 15:44:01.583218 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.590029 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b36a2ba3-954a-4dd9-af9f-4de9c4832577 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.679941 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1076d197-da65-4717-bd71-a20a0902913b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.765893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58190) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:01.777579 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Pushing event updated for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:01.804619 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.854007 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Attempting to bind port fd471234-c522-4ab5-852b-64ca2a29444b on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:01.854630 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Attempting to bind port fd471234-c522-4ab5-852b-64ca2a29444b by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:01.854736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Attempting to bind port fd471234-c522-4ab5-852b-64ca2a29444b on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:01.860447 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Port fd471234-c522-4ab5-852b-64ca2a29444b on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:44:01.860764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Attempting to bind port fd471234-c522-4ab5-852b-64ca2a29444b on network 956d5f61-ae8e-4c95-bd97-6ae439ceff67 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:01.866252 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 43, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:01.866582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Checking segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:01.866959 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Bound using segment: {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:01.867504 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Bound port: fd471234-c522-4ab5-852b-64ca2a29444b, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bca21b3-aa16-450a-a9ae-5cdc39f91476', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 836, 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:01.867874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.917184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.932661 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:01.937098 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Usage tracker for resource:security_group_rule and tenant:3942dea9793d4c4c96d890350bb2ffaa is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:01.940003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:01.945857 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:01.968990 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:01.972339 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fd471234-c522-4ab5-852b-64ca2a29444b,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:01.978060 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.984214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-269dc6b7-d04f-45b3-8fd5-fb51a36e1215 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.044958 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:02.045764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.046795 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] 10.222.0.74 "PUT /v2.0/ports/fd471234-c522-4ab5-852b-64ca2a29444b HTTP/1.1" status: 200 len: 1094 time: 1.1648836 May 25 15:44:02.049893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.050039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:44:02.055594 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.065089 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.075126 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Pushing event updated for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:02.078984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.104363 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3942dea9793d4c4c96d890350bb2ffaa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3370695 May 25 15:44:02.105232 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1e719bd-eb65-40c9-a54b-d25983d22e0b,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:02.107081 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58214) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:02.108302 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.173882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.214262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.269914 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.276716 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c39a1a04-f7ac-44e6-ac73-58a1f48da8a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.289163 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1e719bd-eb65-40c9-a54b-d25983d22e0b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:02.291113 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.293016 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d1e719bd-eb65-40c9-a54b-d25983d22e0b HTTP/1.1" status: 204 len: 168 time: 0.1839936 May 25 15:44:02.293155 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.667357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.354954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58260) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:03.469577 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.491468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:03.495387 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Usage tracker for resource:security_group_rule and tenant:1790f762e78d4c5a87fb3c75ad216d4e is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:03.498223 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:03.503916 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:03.587102 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.590732 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.599337 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7f6d7aab-df28-4944-8d58-d12bd197839d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.636560 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1790f762e78d4c5a87fb3c75ad216d4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2804880 May 25 15:44:03.638116 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4dd0fe7c-49b6-4c0d-accb-28d2ef1f7fa4,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:03.639222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58268) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:03.642156 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.696763 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.721850 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.775187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.778543 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.792383 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4dd0fe7c-49b6-4c0d-accb-28d2ef1f7fa4,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:03.794859 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.804238 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.807838 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4dd0fe7c-49b6-4c0d-accb-28d2ef1f7fa4 HTTP/1.1" status: 204 len: 168 time: 0.1650999 May 25 15:44:04.381335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.583528 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58298) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:04.734201 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1178954393-network', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:04.738682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:04.742449 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Usage tracker for resource:network and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:04.745310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:04.752190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:04.761730 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Made reservation on behalf of 36a8e64d79d14b1bbc49f2fc6ee6efef for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:04.764057 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.775542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.789245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:04.792952 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:04.795830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:04.802433 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:04.882167 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.886032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.889116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fbd72c77-5a42-4632-afd8-865e092eeb6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:04.919490 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] vlan segment allocate from pool success with {'vlan_id': 815, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:44:04.924780 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4251fe3-9b3d-448a-8c8c-225e9729fc9f,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:04.928259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:04.931790 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.932935 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Added segment d5529774-91f8-48d1-babd-bb3f655c1d53 of type vlan for network 766a97d7-d18b-48a7-bf13-6371007ad277 May 25 15:44:04.957211 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.985802 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.987095 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:04.987697 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:04.990869 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-acda8de9-7b72-4c55-ac36-2ff1ac5924f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:05.086534 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Pushing event updated for resources: {'Network': ['ID=766a97d7-d18b-48a7-bf13-6371007ad277,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:05.089295 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5047405 May 25 15:44:05.090166 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:05.092340 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58304) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:05.098113 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Request body: {'subnet': {'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1178954393-subnet', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:05.098454 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 766a97d7-d18b-48a7-bf13-6371007ad277 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:44:05.102935 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:05.106710 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Usage tracker for resource:subnet and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:05.110212 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:05.116231 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:05.126159 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Made reservation on behalf of 36a8e64d79d14b1bbc49f2fc6ee6efef for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:05.128639 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3745239'] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.563325 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3356678', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3745217'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.568288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-812021e4-b045-4c89-b91b-9d95b0669904 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:05.626205 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.635168 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3d39e59e-789e-4e2f-8d7b-d42051f9d502,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:05.638974 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:05.646605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Checking segment: {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:05.647241 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Network hostable DHCP agents. Network: 766a97d7-d18b-48a7-bf13-6371007ad277, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:44:05.664722 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Network 766a97d7-d18b-48a7-bf13-6371007ad277 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:44:05.673921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 766a97d7-d18b-48a7-bf13-6371007ad277) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:05.687138 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cba33b8a-d913-498f-b31f-58db65a93bb1 None None] Network 766a97d7-d18b-48a7-bf13-6371007ad277 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:05.688650 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:05.689247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.716911 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6212854 May 25 15:44:05.717649 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58314) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:05.725436 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:05.734618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:05.740406 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Usage tracker for resource:router and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:05.743260 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:05.750194 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:05.770805 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.772042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.787456 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.881529 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b', 'status': 'completed', 'code': 200} May 25 15:44:05.914251 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-766a97d7-d18b-48a7-bf13-6371007ad277', 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'fixed_ips': [{'subnet_id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:44:05.915380 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.086786 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5789a0a-8768-49e6-a918-a359251a4786 req-6b28a9a9-5ed1-4155-8fbe-cc9fa00fa29c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:06.088319 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c5789a0a-8768-49e6-a918-a359251a4786 req-6b28a9a9-5ed1-4155-8fbe-cc9fa00fa29c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1531832 May 25 15:44:06.102590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Allocated IP 172.20.0.2 (766a97d7-d18b-48a7-bf13-6371007ad277/3d39e59e-789e-4e2f-8d7b-d42051f9d502/1e859884-3874-48e0-8b1b-36e5d92d44e6) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:06.103046 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6568bc4-4413-40a5-a820-4bd24b03bfe9 req-4b5390f6-78ea-4382-aaef-4ae21c212ca0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:06.104885 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6568bc4-4413-40a5-a820-4bd24b03bfe9 req-4b5390f6-78ea-4382-aaef-4ae21c212ca0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 944 time: 0.1672916 May 25 15:44:06.178863 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.193548 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c5789a0a-8768-49e6-a918-a359251a4786 req-883ae435-e65c-4a5e-933d-dcb2f8b7084c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873516 May 25 15:44:06.212073 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6568bc4-4413-40a5-a820-4bd24b03bfe9 req-7a6cc7f8-d68f-465f-8682-21c283f81ba1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912714 May 25 15:44:06.215723 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-fd70654c-fae9-404c-ae91-e579c0f3fe47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:06.217156 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-fd70654c-fae9-404c-ae91-e579c0f3fe47 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 1097 time: 0.3380470 May 25 15:44:06.340788 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.342450 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-dfb976a2-9a77-4956-98d0-94254b71b56e service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fd471234-c522-4ab5-852b-64ca2a29444b HTTP/1.1" status: 200 len: 217 time: 0.0626528 May 25 15:44:06.351349 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Transition to ACTIVE for port object 1e859884-3874-48e0-8b1b-36e5d92d44e6 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:06.369449 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Transition to ACTIVE for port object 1e859884-3874-48e0-8b1b-36e5d92d44e6 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:06.374718 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.378955 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:06.443243 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Network 766a97d7-d18b-48a7-bf13-6371007ad277 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:06.446242 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:06.450146 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:06.459536 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Pushing event updated for resources: {'Port': ['ID=1e859884-3874-48e0-8b1b-36e5d92d44e6,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:06.525328 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.525672 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.526006 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.526504 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.526836 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.527163 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.527485 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.527832 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.528177 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.528500 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.528818 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.529167 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:06.535959 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-fc792977-4edc-4081-9dd3-353aa23ef88e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:06.537351 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:06.537449 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-fc792977-4edc-4081-9dd3-353aa23ef88e service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.1686862 May 25 15:44:06.558307 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Attempting to bind port 1e859884-3874-48e0-8b1b-36e5d92d44e6 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:06.558776 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Attempting to bind port 1e859884-3874-48e0-8b1b-36e5d92d44e6 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:06.559242 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Attempting to bind port 1e859884-3874-48e0-8b1b-36e5d92d44e6 on network 766a97d7-d18b-48a7-bf13-6371007ad277 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:06.565096 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:06.565475 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Checking segment: {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:06.565876 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.566381 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Bound using segment: {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:06.566846 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Bound port: 1e859884-3874-48e0-8b1b-36e5d92d44e6, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:06.567247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.656337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] For port 1e859884-3874-48e0-8b1b-36e5d92d44e6, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:06.659317 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] For port 1e859884-3874-48e0-8b1b-36e5d92d44e6, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1e859884-3874-48e0-8b1b-36e5d92d44e6,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:06.664117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.667512 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:06.702186 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-f6a1c485-b034-4a23-b5ce-875036857397 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1058784 May 25 15:44:06.755399 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Pushing event updated for resources: {'Port': ['ID=1e859884-3874-48e0-8b1b-36e5d92d44e6,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:06.758539 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:06.870795 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:06.919719 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:07.003495 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-564d59d0-8211-44d7-932e-318096e8bc55 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2674389 May 25 15:44:07.099923 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Allocated IP 172.27.1.136 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/7b28f60d-378b-4a74-bd49-02ec92006c5c) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:07.366558 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:07.395208 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b95557fa-7c32-431c-a9c4-e576d0816a77 req-e0138130-2fe8-402e-9d79-d227c726f866 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2162251 May 25 15:44:07.420357 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:07.426982 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:07.508383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:07.510495 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:07.513801 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:07.574988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32199ade-982c-44d0-b8cf-372d0ee76fb7 req-849314f2-2948-4311-9c47-d988638b1632 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:07.576550 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-32199ade-982c-44d0-b8cf-372d0ee76fb7 req-849314f2-2948-4311-9c47-d988638b1632 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2254534 May 25 15:44:07.591588 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e853d21-8eb6-4d17-9dd7-db1ad9cb29eb req-9a261d1f-544c-4cd9-9b8a-d332eb438f70 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:07.591588 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5e853d21-8eb6-4d17-9dd7-db1ad9cb29eb req-9a261d1f-544c-4cd9-9b8a-d332eb438f70 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 944 time: 0.1845670 May 25 15:44:07.656552 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1e859884-3874-48e0-8b1b-36e5d92d44e6 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:07.704594 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Pushing event updated for resources: {'Port': ['ID=7b28f60d-378b-4a74-bd49-02ec92006c5c,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:07.717375 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-32199ade-982c-44d0-b8cf-372d0ee76fb7 req-eed6914f-400e-4e30-a4ee-5e5b9bb98276 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1265366 May 25 15:44:07.722537 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:07.723348 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5e853d21-8eb6-4d17-9dd7-db1ad9cb29eb req-afa84929-4621-48a2-81c2-1b18ccad7e7a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094835 May 25 15:44:07.781700 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 1e859884-3874-48e0-8b1b-36e5d92d44e6 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:07.807016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-855ee6a7-3980-4a83-910d-b5d7faee7ea6 None None] Network 766a97d7-d18b-48a7-bf13-6371007ad277 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:07.890528 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Provisioning for port 1e859884-3874-48e0-8b1b-36e5d92d44e6 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:07.903831 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Provisioning complete for port 1e859884-3874-48e0-8b1b-36e5d92d44e6 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:07.904221 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:07.944122 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-3969487d-f55c-46f8-8ee3-1d8863583dac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:07.945645 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-3969487d-f55c-46f8-8ee3-1d8863583dac service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 1097 time: 0.2854123 May 25 15:44:08.100035 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:08.210581 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] For port 1e859884-3874-48e0-8b1b-36e5d92d44e6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1e859884-3874-48e0-8b1b-36e5d92d44e6,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:08.216687 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:08.219193 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-47550097-ab30-43c4-85f3-2807fc237dfd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:08.257133 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:08.300635 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Pushing event updated for resources: {'Port': ['ID=1e859884-3874-48e0-8b1b-36e5d92d44e6,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:08.304747 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:08.366813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-4732b3f4-65fa-4ba7-808e-d7e268d243d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:08.368291 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-4732b3f4-65fa-4ba7-808e-d7e268d243d7 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.3964486 May 25 15:44:08.498959 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-594567da-19fb-482e-834a-8010ca6fcb26 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fd471234-c522-4ab5-852b-64ca2a29444b HTTP/1.1" status: 200 len: 217 time: 0.0795159 May 25 15:44:08.542152 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-a0e8e9cf-ca8f-4c2e-acbe-8a5c1b490128 None None] Provisioning complete for port 1e859884-3874-48e0-8b1b-36e5d92d44e6 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:08.542537 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a0e8e9cf-ca8f-4c2e-acbe-8a5c1b490128 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:08.729656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-1e1da962-ed7f-4c74-84e2-8b4d96445f42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:08.731444 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-1e1da962-ed7f-4c74-84e2-8b4d96445f42 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.1523314 May 25 15:44:08.753882 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:08.871862 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-e9e10874-13fd-4623-87e1-6817c1d4d5be service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1193819 May 25 15:44:08.982244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9be575-138d-4cc1-b2af-fcbfab33ed94 req-b3408813-0ce6-408c-9bba-d2783dad821c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:08.984120 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8f9be575-138d-4cc1-b2af-fcbfab33ed94 req-b3408813-0ce6-408c-9bba-d2783dad821c tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1467495 May 25 15:44:08.992496 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5299f6c-e811-4677-87d8-b6d778be88c0 req-883a05d2-306f-4fe6-88a8-e038fc88b2cf tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:08.993893 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5299f6c-e811-4677-87d8-b6d778be88c0 req-883a05d2-306f-4fe6-88a8-e038fc88b2cf tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 944 time: 0.1138873 May 25 15:44:09.066402 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8f9be575-138d-4cc1-b2af-fcbfab33ed94 req-48079b60-07c3-4418-a3c0-3a6e4a62798f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715444 May 25 15:44:09.073188 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5299f6c-e811-4677-87d8-b6d778be88c0 req-ce363a70-ac29-45e5-8185-f888c26a4304 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653164 May 25 15:44:09.093834 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-54bb9261-ca11-4155-af94-81ae4fde008c service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1629379 May 25 15:44:09.132820 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Router 10d45808-9326-4631-b06a-49b522151a35 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:44:09.486180 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-8a69c1e5-18b8-4af0-b55a-267e656bbac2 req-42636625-88af-4914-b59f-8156f629e744 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3763428 May 25 15:44:09.499584 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:09.510448 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Sync routers for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:09.520188 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:09.522251 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:09.549814 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:09.553743 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 3.8324990 May 25 15:44:09.554165 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58386) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:09.574655 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1e859884-3874-48e0-8b1b-36e5d92d44e6 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:09.667858 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 1e859884-3874-48e0-8b1b-36e5d92d44e6 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:09.668510 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:09.767892 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:10.064410 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58400) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:10.075534 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:07Z', 'revision_number': 3, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:10.080478 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Checking router: 10d45808-9326-4631-b06a-49b522151a35 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:10.081021 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Updating router 10d45808-9326-4631-b06a-49b522151a35 port 7b28f60d-378b-4a74-bd49-02ec92006c5c binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:10.154287 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.253757 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.269466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:10.273268 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Usage tracker for resource:security_group_rule and tenant:4045e4cc0dd649a8ad5f57539fc94af8 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:10.276137 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:10.281916 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:10.387564 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.392910 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.402797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.448529 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4045e4cc0dd649a8ad5f57539fc94af8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3827760 May 25 15:44:10.450173 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58412) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:10.453867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=007b8382-2ec9-43e7-9795-156dd8c2f57e,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:10.495002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:10.522583 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.537117 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.555029 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Transition to ACTIVE for port object 7b28f60d-378b-4a74-bd49-02ec92006c5c will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:10.560901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.564466 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.564685 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.568543 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.581469 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bb290c-63f0-47f4-b8ef-7ceb31260e2a req-312b889b-068e-4439-aba1-cf36501025ea tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:10.582892 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16bb290c-63f0-47f4-b8ef-7ceb31260e2a req-312b889b-068e-4439-aba1-cf36501025ea tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 944 time: 0.3109751 May 25 15:44:10.600268 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62539cd5-9d2d-41de-8eea-3eac13ba9a5c req-8709bc8b-588a-4992-aa8f-c62122640f4f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:10.601934 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-62539cd5-9d2d-41de-8eea-3eac13ba9a5c req-8709bc8b-588a-4992-aa8f-c62122640f4f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.3310366 May 25 15:44:10.628941 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.634508 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fbe3d216-a143-4708-b5f8-5f5713baa2f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.649672 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.653390 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/007b8382-2ec9-43e7-9795-156dd8c2f57e HTTP/1.1" status: 204 len: 168 time: 0.1990399 May 25 15:44:10.659227 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Pushing event updated for resources: {'Port': ['ID=7b28f60d-378b-4a74-bd49-02ec92006c5c,revision_number=2']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:10.662152 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=007b8382-2ec9-43e7-9795-156dd8c2f57e,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:10.666961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:10.689205 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.689887 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.690543 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.691382 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.691755 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.692258 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.693062 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.693540 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.694414 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.695070 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.696023 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.696640 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:10.699459 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Attempting to bind port 7b28f60d-378b-4a74-bd49-02ec92006c5c on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:10.699856 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Attempting to bind port 7b28f60d-378b-4a74-bd49-02ec92006c5c by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:10.700218 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Attempting to bind port 7b28f60d-378b-4a74-bd49-02ec92006c5c on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:10.706736 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:10.707951 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:10.708631 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:10.709212 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.709607 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:10.710077 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Bound port: 7b28f60d-378b-4a74-bd49-02ec92006c5c, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:10.710454 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.730338 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-62539cd5-9d2d-41de-8eea-3eac13ba9a5c req-9eefd233-4ce8-474a-9b72-b33313f77afb tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061933 May 25 15:44:10.738226 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16bb290c-63f0-47f4-b8ef-7ceb31260e2a req-dbd44c99-41b7-4f5f-a224-1e53f8051d3a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1469257 May 25 15:44:10.800931 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] For port 7b28f60d-378b-4a74-bd49-02ec92006c5c, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:10.805396 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] For port 7b28f60d-378b-4a74-bd49-02ec92006c5c, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=7b28f60d-378b-4a74-bd49-02ec92006c5c,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:10.812716 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:10.825170 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.895647 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:10.896412 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:10.943815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Allocated IP 172.20.0.1 (766a97d7-d18b-48a7-bf13-6371007ad277/3d39e59e-789e-4e2f-8d7b-d42051f9d502/61aa8fef-57f0-4938-b812-35122c4cf6b1) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:11.078521 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Pushing event updated for resources: {'Port': ['ID=7b28f60d-378b-4a74-bd49-02ec92006c5c,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:11.083526 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-e32fa844-7dba-4da5-8e44-47c742af23ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:11.100075 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:11.123116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.141950 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Transition to ACTIVE for port object 61aa8fef-57f0-4938-b812-35122c4cf6b1 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:11.172245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.175888 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:11.245049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Network 766a97d7-d18b-48a7-bf13-6371007ad277 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:11.248299 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:11.252094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:11.303355 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Pushing event updated for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:11.313830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:11.320716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.432239 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:07Z', 'revision_number': 3, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:11.436338 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8ccfc0-7590-4739-a596-b9293839a84f None None] The sync data for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi is: [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:07Z', 'revision_number': 3, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:11.448155 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.511991 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-41a0929d-d477-408e-a84c-47cb6e5889f4 None None] Provisioning for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:11.517918 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-41a0929d-d477-408e-a84c-47cb6e5889f4 None None] Provisioning complete for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:11.518429 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-41a0929d-d477-408e-a84c-47cb6e5889f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.576166 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-41a0929d-d477-408e-a84c-47cb6e5889f4 None None] Port 61aa8fef-57f0-4938-b812-35122c4cf6b1 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:11.656361 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fd471234-c522-4ab5-852b-64ca2a29444b details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:44:11.711386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.716888 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.744831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:11.851774 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.860427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Pushing event updated for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:11.861797 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fd471234-c522-4ab5-852b-64ca2a29444b,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:11.864874 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:11.880306 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'fd471234-c522-4ab5-852b-64ca2a29444b', 'network_id': '956d5f61-ae8e-4c95-bd97-6ae439ceff67', 'port_id': 'fd471234-c522-4ab5-852b-64ca2a29444b', 'mac_address': 'fa:16:3e:b6:35:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 836, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bf87cdb0-06e4-4ee0-ad97-e62e40212515', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:44:11.946566 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.965489 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd471234-c522-4ab5-852b-64ca2a29444b {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:44:11.984203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fd471234-c522-4ab5-852b-64ca2a29444b,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:11.988880 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.991298 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:12.074247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:12.077589 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:12.133794 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Network 766a97d7-d18b-48a7-bf13-6371007ad277 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:12.136440 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:12.206432 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fddb1b9-c9c3-47d5-bba2-cf0223309a2a req-fd584d60-9675-4453-8d63-78af7f94b90c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:12.207990 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0fddb1b9-c9c3-47d5-bba2-cf0223309a2a req-fd584d60-9675-4453-8d63-78af7f94b90c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 945 time: 0.2625751 May 25 15:44:12.215468 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8a40e9-4f3c-44bb-9462-34e95ec4dac8 req-778095a9-2083-4c92-9407-ffe1cbfef4d7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:12.220158 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fa8a40e9-4f3c-44bb-9462-34e95ec4dac8 req-778095a9-2083-4c92-9407-ffe1cbfef4d7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2805364 May 25 15:44:12.409618 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-cd9a3a65-dec3-41fc-9acf-a1443d4362ce None None] Provisioning complete for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:12.409997 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cd9a3a65-dec3-41fc-9acf-a1443d4362ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.468267 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-cd9a3a65-dec3-41fc-9acf-a1443d4362ce None None] Port 61aa8fef-57f0-4938-b812-35122c4cf6b1 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:12.469720 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0fddb1b9-c9c3-47d5-bba2-cf0223309a2a req-874a006b-4230-46f3-af36-6a26d71b0c33 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2484033 May 25 15:44:12.486973 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fa8a40e9-4f3c-44bb-9462-34e95ec4dac8 req-3ab781fd-6e38-459c-8e2e-c8409c0a9708 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2569873 May 25 15:44:12.513965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Router 10d45808-9326-4631-b06a-49b522151a35 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:44:12.699579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:12.708667 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] 10.222.0.25 "PUT /v2.0/routers/10d45808-9326-4631-b06a-49b522151a35/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1535144 May 25 15:44:12.971785 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['fd471234-c522-4ab5-852b-64ca2a29444b'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:44:13.106076 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Sync routers for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:13.141747 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:13.141747 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:13.340491 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58454) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:13.347424 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-888784765-network', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:13.353949 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:13.364486 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:13.368575 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Usage tracker for resource:network and tenant:f0a47009ab974064b83bafb40da198fb is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:13.371438 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:13.382148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:13.395187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Made reservation on behalf of f0a47009ab974064b83bafb40da198fb for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:13.397999 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.410655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.428375 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:13.432968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Usage tracker for resource:security_group_rule and tenant:f0a47009ab974064b83bafb40da198fb is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:13.436182 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:13.443342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:13.552140 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.558277 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.563165 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-edb193cb-f8d2-4cc4-b098-37fbc3873e4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.584370 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] vlan segment allocate from pool success with {'vlan_id': 821, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:44:13.605513 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=378f42c2-c243-451a-a096-beef12da50c7,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:13.609770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.612882 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.613397 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Added segment e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af of type vlan for network 876389b2-0a69-4c25-a66f-a8a53f772943 May 25 15:44:13.667249 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 7b28f60d-378b-4a74-bd49-02ec92006c5c up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:13.727035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.795320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.800176 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:13.800754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.808024 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.832423 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 7b28f60d-378b-4a74-bd49-02ec92006c5c completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:13.840297 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 7b28f60d-378b-4a74-bd49-02ec92006c5c triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:13.840694 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.847802 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5927d3bc-9368-4f43-a686-009fd79ef887 req-eca81dcc-bb70-4875-a264-4ce90f0ea76a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:13.849246 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5927d3bc-9368-4f43-a686-009fd79ef887 req-eca81dcc-bb70-4875-a264-4ce90f0ea76a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 945 time: 0.2123177 May 25 15:44:13.909963 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:11Z', 'revision_number': 4, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '61aa8fef-57f0-4938-b812-35122c4cf6b1', 'name': '', 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'mac_address': 'fa:16:3e:70:e0:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:10Z', 'updated_at': '2021-05-25T15:44:11Z', 'revision_number': 2, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'subnets': [{'id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:13.917398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Checking router: 10d45808-9326-4631-b06a-49b522151a35 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:13.917697 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Updating router 10d45808-9326-4631-b06a-49b522151a35 port 61aa8fef-57f0-4938-b812-35122c4cf6b1 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:13.941891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51133d23-1664-4a94-9a15-838198a3bc2a req-df0d3a63-8ec4-43a3-a54b-62ca1fe927d5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:13.943315 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-51133d23-1664-4a94-9a15-838198a3bc2a req-df0d3a63-8ec4-43a3-a54b-62ca1fe927d5 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2605135 May 25 15:44:13.969267 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6240897 May 25 15:44:13.969267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Pushing event updated for resources: {'Network': ['ID=876389b2-0a69-4c25-a66f-a8a53f772943,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:13.970177 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58468) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:13.970684 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.979827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Request body: {'subnet': {'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-888784765-subnet', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:13.986885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:13.991441 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Usage tracker for resource:subnet and tenant:f0a47009ab974064b83bafb40da198fb is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:13.997036 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 876389b2-0a69-4c25-a66f-a8a53f772943 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:44:13.998107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:14.002604 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5927d3bc-9368-4f43-a686-009fd79ef887 req-d6f9ec90-4ebd-4c99-a03c-4ddedaf6d876 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075947 May 25 15:44:14.008347 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:14.026189 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-51133d23-1664-4a94-9a15-838198a3bc2a req-8008c5f8-c7a7-4bb5-aab3-f9978f2fe889 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708990 May 25 15:44:14.031789 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Made reservation on behalf of f0a47009ab974064b83bafb40da198fb for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:14.034640 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.107816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.137218 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.216868 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 7b28f60d-378b-4a74-bd49-02ec92006c5c, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=7b28f60d-378b-4a74-bd49-02ec92006c5c,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:14.257215 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.266348 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.373477 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=7b28f60d-378b-4a74-bd49-02ec92006c5c,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:14.376698 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.454991 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.460698 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-862e1595-9023-4abc-a401-ec0577fb3292 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.537307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Pushing event updated for resources: {'Subnet': ['ID=06e2e670-b73e-47cd-82bb-dc18be18bd2e,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:14.541955 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.549675 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Checking segment: {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:14.550034 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Network hostable DHCP agents. Network: 876389b2-0a69-4c25-a66f-a8a53f772943, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:44:14.567431 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Network 876389b2-0a69-4c25-a66f-a8a53f772943 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:44:14.571346 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.581367 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 876389b2-0a69-4c25-a66f-a8a53f772943) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:14.588011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Transition to ACTIVE for port object 61aa8fef-57f0-4938-b812-35122c4cf6b1 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:14.591324 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:14.592071 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.592171 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0baa772c-e1ab-47a7-aba0-95183c890651 None None] Network 876389b2-0a69-4c25-a66f-a8a53f772943 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:14.616050 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3ba6198a-d3e4-4463-8292-763ade3eee1e admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6440408 May 25 15:44:14.618480 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58476) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:14.624664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:14.629431 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:14.633461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Usage tracker for resource:router and tenant:f0a47009ab974064b83bafb40da198fb is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:14.636392 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:14.642900 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:14.655035 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.656084 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.660014 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.673358 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.679315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.840851 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Pushing event updated for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:14.848151 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.986138 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Attempting to bind port 61aa8fef-57f0-4938-b812-35122c4cf6b1 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:14.986517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Attempting to bind port 61aa8fef-57f0-4938-b812-35122c4cf6b1 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:14.986885 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Attempting to bind port 61aa8fef-57f0-4938-b812-35122c4cf6b1 on network 766a97d7-d18b-48a7-bf13-6371007ad277 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:14.989216 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.000767 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:15.001349 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Checking segment: {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:15.001517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.001909 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Bound using segment: {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:15.002383 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Bound port: 61aa8fef-57f0-4938-b812-35122c4cf6b1, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd5529774-91f8-48d1-babd-bb3f655c1d53', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:15.002758 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.149438 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-876389b2-0a69-4c25-a66f-a8a53f772943', 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'fixed_ips': [{'subnet_id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:44:15.150673 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.226280 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] For port 61aa8fef-57f0-4938-b812-35122c4cf6b1, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:15.239293 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24bd715-3037-4e66-a821-6f2e67c29b64 req-7cbffb0e-7452-4a8a-8c82-37967fa01975 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:15.240915 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d24bd715-3037-4e66-a821-6f2e67c29b64 req-7cbffb0e-7452-4a8a-8c82-37967fa01975 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 945 time: 0.0935998 May 25 15:44:15.249802 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] For port 61aa8fef-57f0-4938-b812-35122c4cf6b1, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=61aa8fef-57f0-4938-b812-35122c4cf6b1,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:15.258117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.269610 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-39b915db-3513-4a27-b91c-15d681d0b93d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:15.319963 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d24bd715-3037-4e66-a821-6f2e67c29b64 req-bb12d5ad-83c0-4560-aec7-7d69d1064d3f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704987 May 25 15:44:15.417809 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.456401 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:15.517086 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:15.517423 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:15.645925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 7b28f60d-378b-4a74-bd49-02ec92006c5c up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:15.675860 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Pushing event updated for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:15.696025 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fd471234-c522-4ab5-852b-64ca2a29444b up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:15.727885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Allocated IP 172.27.1.231 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/a84350f2-53bf-4f19-95c7-f9ac0a8772e3) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:15.738170 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.473s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:15.753693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdefc1f-f251-4b2c-8242-e9d086a2bc30 req-2d884dbd-fc2c-4ba9-89e8-fa9f3d05c4c1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:15.759084 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5fdefc1f-f251-4b2c-8242-e9d086a2bc30 req-2d884dbd-fc2c-4ba9-89e8-fa9f3d05c4c1 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2276840 May 25 15:44:15.810531 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5fdefc1f-f251-4b2c-8242-e9d086a2bc30 req-05ff9f7b-d98d-4d8e-b436-7a12bf315fae tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430019 May 25 15:44:15.868700 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Allocated IP 172.20.0.2 (876389b2-0a69-4c25-a66f-a8a53f772943/06e2e670-b73e-47cd-82bb-dc18be18bd2e/9688f604-230e-4cea-b407-06e7ca818213) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:16.003058 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.007362 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:16.033119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.038680 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2cb28111-a0fe-4328-91f2-0436ae8a19e4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:16.105413 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port fd471234-c522-4ab5-852b-64ca2a29444b completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:16.111234 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:16.114346 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:16.118252 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:16.121273 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 7b28f60d-378b-4a74-bd49-02ec92006c5c triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:16.121679 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.159791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Pushing event updated for resources: {'Port': ['ID=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:16.168042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:16.229190 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port fd471234-c522-4ab5-852b-64ca2a29444b triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:16.229568 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.526072 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4324e2b-adfc-4dec-9bef-d40baf32ce43 req-793faaed-ae89-45a6-819a-488458576567 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:16.533828 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e4324e2b-adfc-4dec-9bef-d40baf32ce43 req-793faaed-ae89-45a6-819a-488458576567 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 945 time: 0.1022348 May 25 15:44:16.560881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.587158 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e4324e2b-adfc-4dec-9bef-d40baf32ce43 req-4aeb2c5e-feca-47ff-a96b-55e1aa389c2d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519946 May 25 15:44:16.668948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.774268 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Transition to ACTIVE for port object 9688f604-230e-4cea-b407-06e7ca818213 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:16.827989 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Transition to ACTIVE for port object 9688f604-230e-4cea-b407-06e7ca818213 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:16.832345 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.851893 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:16.860164 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:16.939684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Network 876389b2-0a69-4c25-a66f-a8a53f772943 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:16.945588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:44:16.954884 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:16.963345 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:16.971478 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fd471234-c522-4ab5-852b-64ca2a29444b,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:16.975337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Pushing event updated for resources: {'Port': ['ID=9688f604-230e-4cea-b407-06e7ca818213,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:17.005682 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.009887 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:17.016384 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.024234 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:17.034750 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c7bc5e-e95c-4f11-afe9-c23a17ba8e7b req-eb5f689a-7ad4-403c-939d-cffb827d6c52 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:17.041710 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d1c7bc5e-e95c-4f11-afe9-c23a17ba8e7b req-eb5f689a-7ad4-403c-939d-cffb827d6c52 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1135938 May 25 15:44:17.084153 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d1c7bc5e-e95c-4f11-afe9-c23a17ba8e7b req-a98d76d2-cbdf-4d81-a24f-dd46f40dff78 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414405 May 25 15:44:17.127217 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:11Z', 'revision_number': 4, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '61aa8fef-57f0-4938-b812-35122c4cf6b1', 'name': '', 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'mac_address': 'fa:16:3e:70:e0:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:10Z', 'updated_at': '2021-05-25T15:44:15Z', 'revision_number': 4, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'subnets': [{'id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:17.143591 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b48d0ab1-1a6b-4914-a221-a9da015a30e6 None None] The sync data for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi is: [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:44:11Z', 'revision_number': 4, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '61aa8fef-57f0-4938-b812-35122c4cf6b1', 'name': '', 'network_id': '766a97d7-d18b-48a7-bf13-6371007ad277', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'mac_address': 'fa:16:3e:70:e0:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:10Z', 'updated_at': '2021-05-25T15:44:15Z', 'revision_number': 4, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'subnets': [{'id': '3d39e59e-789e-4e2f-8d7b-d42051f9d502', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:17.145181 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Attempting to bind port 9688f604-230e-4cea-b407-06e7ca818213 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:17.145608 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Attempting to bind port 9688f604-230e-4cea-b407-06e7ca818213 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:17.146245 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Attempting to bind port 9688f604-230e-4cea-b407-06e7ca818213 on network 876389b2-0a69-4c25-a66f-a8a53f772943 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:17.149065 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b', 'code': 200} May 25 15:44:17.157873 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:17.158208 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Checking segment: {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:17.158582 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.158987 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Bound using segment: {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:17.159456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Bound port: 9688f604-230e-4cea-b407-06e7ca818213, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:17.159862 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.170768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:17.177367 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:17.262796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Router f81a3f6c-a0d3-4fbf-98f5-79256552200b is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:44:17.300197 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] For port 9688f604-230e-4cea-b407-06e7ca818213, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:17.304774 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] For port 9688f604-230e-4cea-b407-06e7ca818213, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9688f604-230e-4cea-b407-06e7ca818213,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:17.309905 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.315315 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:17.462803 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Pushing event updated for resources: {'Port': ['ID=9688f604-230e-4cea-b407-06e7ca818213,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:17.470584 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:17.622430 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 61aa8fef-57f0-4938-b812-35122c4cf6b1 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:17.678754 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:17.710500 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Sync routers for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:17.740202 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:17.740339 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55da82de-f46c-45c0-83a8-cf5eb7632f81 req-f1bc2074-4e5d-4e1c-968e-9562f2a5f935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:17.740827 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:17.742287 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-55da82de-f46c-45c0-83a8-cf5eb7632f81 req-f1bc2074-4e5d-4e1c-968e-9562f2a5f935 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 1099 time: 0.1735046 May 25 15:44:17.765755 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.767198 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.1477265 May 25 15:44:17.769998 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58522) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:17.801153 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:17.806647 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:17.807019 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.892722 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-55da82de-f46c-45c0-83a8-cf5eb7632f81 req-45d72ff7-c68e-412f-8153-f248485f0fc5 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1239853 May 25 15:44:18.038422 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.063424 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:18.082391 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 61aa8fef-57f0-4938-b812-35122c4cf6b1, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=61aa8fef-57f0-4938-b812-35122c4cf6b1,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:18.094415 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.096945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-026fc970-193b-4f5d-9cf1-a8635cf5cbf4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:18.178400 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:18.181627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:18.387679 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:16Z', 'revision_number': 3, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:18.392386 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Checking router: f81a3f6c-a0d3-4fbf-98f5-79256552200b for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:18.392737 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Updating router f81a3f6c-a0d3-4fbf-98f5-79256552200b port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:18.431330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70eaa0c5-9e96-46bf-99a8-eef19b6b3603 req-9bbc3b9d-3d61-47b2-99e0-c8e58abd60d7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:18.435639 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-70eaa0c5-9e96-46bf-99a8-eef19b6b3603 req-9bbc3b9d-3d61-47b2-99e0-c8e58abd60d7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.3776608 May 25 15:44:18.456421 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.588701 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-70eaa0c5-9e96-46bf-99a8-eef19b6b3603 req-cbe379a0-7587-4da7-bceb-c6c5da73c518 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1402245 May 25 15:44:18.758587 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1419ba74-764f-4cbc-9d19-5796f7e6a07a None None] Network 876389b2-0a69-4c25-a66f-a8a53f772943 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:18.867484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-a52ea7cf-adc3-46ff-8a5f-4ad3428fe62c None None] Provisioning for port 9688f604-230e-4cea-b407-06e7ca818213 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:18.873134 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.887875 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Transition to ACTIVE for port object a84350f2-53bf-4f19-95c7-f9ac0a8772e3 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:18.897932 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.903684 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-9f24a9b5-149e-4952-bb16-d1d2afe23c0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:18.996875 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202fe7ad-ab29-4a94-b49f-1893642c4d6a req-5b422797-e519-43ff-9b79-333ba40007b9 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:18.999409 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-202fe7ad-ab29-4a94-b49f-1893642c4d6a req-5b422797-e519-43ff-9b79-333ba40007b9 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2703755 May 25 15:44:19.022118 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Attempting to bind port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:19.022478 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Attempting to bind port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:19.022839 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Attempting to bind port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:19.024811 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8cce6ff-cc39-4ed2-95e0-453ceafa44c9 None None] Pushing event updated for resources: {'Port': ['ID=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,revision_number=2']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:19.028486 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-e8cce6ff-cc39-4ed2-95e0-453ceafa44c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:19.031676 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:19.032050 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:19.032443 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.032922 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:19.033268 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Bound port: a84350f2-53bf-4f19-95c7-f9ac0a8772e3, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:19.033727 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.063595 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.123058 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] For port a84350f2-53bf-4f19-95c7-f9ac0a8772e3, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:19.127710 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] For port a84350f2-53bf-4f19-95c7-f9ac0a8772e3, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:19.135440 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.138687 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-202fe7ad-ab29-4a94-b49f-1893642c4d6a req-99c19de4-1a5c-4d3e-bce2-34ab267fd32d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302354 May 25 15:44:19.140381 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:19.217873 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:19.218491 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:19.277924 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8cce6ff-cc39-4ed2-95e0-453ceafa44c9 None None] Pushing event updated for resources: {'Port': ['ID=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:19.290852 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-e8cce6ff-cc39-4ed2-95e0-453ceafa44c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:19.301478 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Allocated IP 172.20.0.1 (876389b2-0a69-4c25-a66f-a8a53f772943/06e2e670-b73e-47cd-82bb-dc18be18bd2e/c96a896c-2be9-475f-882c-2aabf562e20e) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:19.396021 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:19.447894 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.464017 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Transition to ACTIVE for port object c96a896c-2be9-475f-882c-2aabf562e20e will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:19.488690 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.493818 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e6d9f5ee-cdaf-49b7-98b5-33e39cc49bc5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:19.560203 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Network 876389b2-0a69-4c25-a66f-a8a53f772943 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:19.563777 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:19.567659 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:19.614507 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Pushing event updated for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:19.617957 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:19.637670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.690910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 61aa8fef-57f0-4938-b812-35122c4cf6b1 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:19.710329 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:16Z', 'revision_number': 3, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:19.714535 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11c19c53-ce3a-4d43-b7f7-de7186b44fb7 None None] The sync data for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi is: [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:16Z', 'revision_number': 3, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:19.840849 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 61aa8fef-57f0-4938-b812-35122c4cf6b1 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:19.841458 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.935595 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.960455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac304875-f2e9-448f-bcd2-a97d8ec49867 req-47232db7-2f2d-43d7-9c39-566b59322f5f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:19.962614 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ac304875-f2e9-448f-bcd2-a97d8ec49867 req-47232db7-2f2d-43d7-9c39-566b59322f5f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.1741273 May 25 15:44:19.988281 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-b9ea2498-e07f-4b06-82cd-14a331e5a88a None None] Provisioning for port c96a896c-2be9-475f-882c-2aabf562e20e completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:19.997642 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-b9ea2498-e07f-4b06-82cd-14a331e5a88a None None] Provisioning complete for port c96a896c-2be9-475f-882c-2aabf562e20e triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:19.997642 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b9ea2498-e07f-4b06-82cd-14a331e5a88a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.092124 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ac304875-f2e9-448f-bcd2-a97d8ec49867 req-6bc09c9d-1c44-4570-8e22-4165b013b515 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950181 May 25 15:44:20.096350 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-b9ea2498-e07f-4b06-82cd-14a331e5a88a None None] Port c96a896c-2be9-475f-882c-2aabf562e20e cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:20.121226 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9688f604-230e-4cea-b407-06e7ca818213 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:20.138768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2376404-7c8b-4d09-9303-4eb6f1cf5952 req-a73f5f64-e0c6-47bb-8a7f-5cd31604ba9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:20.141330 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b2376404-7c8b-4d09-9303-4eb6f1cf5952 req-a73f5f64-e0c6-47bb-8a7f-5cd31604ba9b service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.1569576 May 25 15:44:20.224754 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b2376404-7c8b-4d09-9303-4eb6f1cf5952 req-a9724d49-16ba-4e6c-b4de-82e3881e5362 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721972 May 25 15:44:20.242860 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 9688f604-230e-4cea-b407-06e7ca818213 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:20.248577 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 9688f604-230e-4cea-b407-06e7ca818213 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:20.249629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.394703 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.437259 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 9688f604-230e-4cea-b407-06e7ca818213, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9688f604-230e-4cea-b407-06e7ca818213,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:20.437521 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.442337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.444544 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.457791 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860aa567-760a-4378-8646-5f90b0cc8439 req-ac0211a9-2604-45dc-84e1-1ea63aac7e1e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:20.461235 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-860aa567-760a-4378-8646-5f90b0cc8439 req-ac0211a9-2604-45dc-84e1-1ea63aac7e1e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1157153 May 25 15:44:20.461931 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.498916 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-57c8bf5e-07b8-49af-8457-908427b36a25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.523398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=9688f604-230e-4cea-b407-06e7ca818213,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:20.534342 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.616345 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Pushing event updated for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:20.619210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.624326 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-860aa567-760a-4378-8646-5f90b0cc8439 req-7214185f-5166-48e9-9e92-a067d0348c90 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264734 May 25 15:44:20.627467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.840061 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Network 876389b2-0a69-4c25-a66f-a8a53f772943 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:20.841172 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:21.026558 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Router f81a3f6c-a0d3-4fbf-98f5-79256552200b has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:44:21.027592 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-97a26944-d75a-4c90-8a30-446c78db5a45 None None] Provisioning complete for port c96a896c-2be9-475f-882c-2aabf562e20e triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:21.028055 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-97a26944-d75a-4c90-8a30-446c78db5a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.081608 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-97a26944-d75a-4c90-8a30-446c78db5a45 None None] Port c96a896c-2be9-475f-882c-2aabf562e20e cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:21.213457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:21.224213 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] 10.222.0.25 "PUT /v2.0/routers/f81a3f6c-a0d3-4fbf-98f5-79256552200b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4523544 May 25 15:44:21.435886 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e23e0be2-975e-4760-84c1-8076c28ea704 req-3e9c6abd-ddba-4e0b-80a0-761e02fd2a25 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:21.437976 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e23e0be2-975e-4760-84c1-8076c28ea704 req-3e9c6abd-ddba-4e0b-80a0-761e02fd2a25 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.1021051 May 25 15:44:21.478349 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6034036a-320d-4264-9803-9b00f663664c None None] Sync routers for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:21.491698 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:21.492667 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:21.501554 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e23e0be2-975e-4760-84c1-8076c28ea704 req-491471d7-813a-48f4-bcce-b3f00abb0479 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575905 May 25 15:44:21.673627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9688f604-230e-4cea-b407-06e7ca818213 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:21.760104 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:21.839303 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 9688f604-230e-4cea-b407-06e7ca818213 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:21.839711 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.844435 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04a505d-75b4-4cdf-bb17-d1b4955b8637 req-a04a538a-f32e-47c9-b242-c83eff655212 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:21.845954 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b04a505d-75b4-4cdf-bb17-d1b4955b8637 req-a04a538a-f32e-47c9-b242-c83eff655212 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0833924 May 25 15:44:21.901611 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b04a505d-75b4-4cdf-bb17-d1b4955b8637 req-38279ce1-b770-466c-abbb-b8274fd294df tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410373 May 25 15:44:22.019342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58566) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.024565 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1197560314', 'description': 'tempest-secgroup-smoke-1197560314 description', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.030214 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.034775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.037829 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.044480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.055675 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.075265 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.079480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.082495 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.088134 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.157706 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device a84350f2-53bf-4f19-95c7-f9ac0a8772e3 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:22.163351 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.167399 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.170940 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.212474 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bcb8a81c-38b2-41dd-9ea6-5358eb8336df,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.215206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.219387 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1960511 May 25 15:44:22.219387 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.219660 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58570) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.224527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.230115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.234052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.237218 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.242949 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.261963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.273411 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:22.279253 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 4, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'c96a896c-2be9-475f-882c-2aabf562e20e', 'name': '', 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'mac_address': 'fa:16:3e:88:5e:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:19Z', 'updated_at': '2021-05-25T15:44:20Z', 'revision_number': 2, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'subnets': [{'id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:22.282663 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:22.283023 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.321868 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6034036a-320d-4264-9803-9b00f663664c None None] Checking router: f81a3f6c-a0d3-4fbf-98f5-79256552200b for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:22.322360 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6034036a-320d-4264-9803-9b00f663664c None None] Updating router f81a3f6c-a0d3-4fbf-98f5-79256552200b port c96a896c-2be9-475f-882c-2aabf562e20e binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:22.330978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.336621 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.338794 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c154c018-38a8-463d-a066-caf7d1eb2ec6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.364280 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=87b67ff9-4be8-443c-b8b7-76b4bf432642,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.367170 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.377461 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.379583 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1589248 May 25 15:44:22.382274 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58578) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.387592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.394368 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.395413 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.398515 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.401807 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.408883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.428995 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.515191 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.526881 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.529114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.559185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a140858-d07e-49da-a210-52597434938e,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.563161 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.564607 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.569627 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.571023 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1876285 May 25 15:44:22.573758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58588) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.579047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.585090 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.588978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.591900 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.597742 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.605791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port a84350f2-53bf-4f19-95c7-f9ac0a8772e3, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:22.610326 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.614277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.617925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.694815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.699908 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.702426 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.727481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c4d1073-e5a6-43fb-a866-7d5a5304390e,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.732374 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.744726 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.750806 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58592) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.752082 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a8bd0026-a1bc-402a-b50d-32e3c53d1f94 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1773052 May 25 15:44:22.758495 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.763260 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.767822 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.774918 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.780491 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.786721 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.794289 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:22.816403 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.837100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfac88fd-3778-4455-85d6-84a455d476d1 req-72743c4c-7e26-4173-8f44-4a35999aa260 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:22.837650 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bfac88fd-3778-4455-85d6-84a455d476d1 req-72743c4c-7e26-4173-8f44-4a35999aa260 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.0841985 May 25 15:44:22.891331 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bfac88fd-3778-4455-85d6-84a455d476d1 req-3d5a83f6-7a71-4abf-99e9-7ddee9b50925 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470352 May 25 15:44:22.902312 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.903581 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.910618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.912840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b730a848-76d4-4c7b-ac95-bdb0b2d9aad0 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.927038 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-6034036a-320d-4264-9803-9b00f663664c None None] Transition to ACTIVE for port object c96a896c-2be9-475f-882c-2aabf562e20e will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:22.935097 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20203321-57c7-43d8-9624-e0328681de12,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:22.935753 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.939928 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:22.949063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:22.957447 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:22.962056 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 58600) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:22.968496 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:22.972939 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2209196 May 25 15:44:22.976677 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:22.980916 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:22.985185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:22.996460 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:23.024104 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.securitygroups_db [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Project 36a8e64d79d14b1bbc49f2fc6ee6efef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:44:23.033036 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.079823 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Pushing event updated for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.121413 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.188340 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-6034036a-320d-4264-9803-9b00f663664c None None] Attempting to bind port c96a896c-2be9-475f-882c-2aabf562e20e on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:23.189084 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-6034036a-320d-4264-9803-9b00f663664c None None] Attempting to bind port c96a896c-2be9-475f-882c-2aabf562e20e by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:23.189371 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6034036a-320d-4264-9803-9b00f663664c None None] Attempting to bind port c96a896c-2be9-475f-882c-2aabf562e20e on network 876389b2-0a69-4c25-a66f-a8a53f772943 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:23.196777 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6034036a-320d-4264-9803-9b00f663664c None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:23.197224 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6034036a-320d-4264-9803-9b00f663664c None None] Checking segment: {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:23.197791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.198641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6034036a-320d-4264-9803-9b00f663664c None None] Bound using segment: {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:23.199175 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-6034036a-320d-4264-9803-9b00f663664c None None] Bound port: c96a896c-2be9-475f-882c-2aabf562e20e, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:23.199605 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.219018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.226349 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.234196 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2e660e2d-7df0-4add-b08b-f5d4d55c1286 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.260754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5735c9-657f-4696-b704-345c8e4cecf5 req-3ee35683-0450-4702-b20a-7d494ce7ac56 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:23.262236 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1f5735c9-657f-4696-b704-345c8e4cecf5 req-3ee35683-0450-4702-b20a-7d494ce7ac56 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.2013621 May 25 15:44:23.268154 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=56cf9092-bbea-4141-bd26-8ec8e61b3772,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.270948 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.277113 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.278252 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3150277 May 25 15:44:23.281844 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 58604) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:23.287650 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Request body: {'security_group_rule': {'security_group_id': 'bcb8a81c-38b2-41dd-9ea6-5358eb8336df', 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:23.296889 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:23.303716 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Usage tracker for resource:security_group_rule and tenant:36a8e64d79d14b1bbc49f2fc6ee6efef is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:23.314571 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:23.321178 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:23.335891 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-6034036a-320d-4264-9803-9b00f663664c None None] For port c96a896c-2be9-475f-882c-2aabf562e20e, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:23.336521 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.securitygroups_db [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Project 36a8e64d79d14b1bbc49f2fc6ee6efef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:44:23.339398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-6034036a-320d-4264-9803-9b00f663664c None None] For port c96a896c-2be9-475f-882c-2aabf562e20e, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c96a896c-2be9-475f-882c-2aabf562e20e,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:23.347363 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.348064 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6034036a-320d-4264-9803-9b00f663664c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.350970 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1f5735c9-657f-4696-b704-345c8e4cecf5 req-50a2d9d6-c40a-45c5-8cfb-93098c76196b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759978 May 25 15:44:23.357859 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.429942 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:23.430613 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:44:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:23.509405 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.514227 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.517002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-36551cc7-9ff7-46fd-89ab-d28232dc9231 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.629124 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=843aa692-c19e-4f3c-be79-e0cfb496ee8e,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.640748 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.656792 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.673019 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-d062848c-79d7-49b0-b044-c820064655b8 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3806522 May 25 15:44:23.774011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device a84350f2-53bf-4f19-95c7-f9ac0a8772e3 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:23.828118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:23.903533 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Pushing event updated for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.914538 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.557s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.087776 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:24.088168 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.308746 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-6034036a-320d-4264-9803-9b00f663664c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 4, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'c96a896c-2be9-475f-882c-2aabf562e20e', 'name': '', 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'mac_address': 'fa:16:3e:88:5e:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:19Z', 'updated_at': '2021-05-25T15:44:23Z', 'revision_number': 4, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'subnets': [{'id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:24.313308 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6034036a-320d-4264-9803-9b00f663664c None None] The sync data for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi is: [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:44:19Z', 'revision_number': 4, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'c96a896c-2be9-475f-882c-2aabf562e20e', 'name': '', 'network_id': '876389b2-0a69-4c25-a66f-a8a53f772943', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'mac_address': 'fa:16:3e:88:5e:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_interface', 'standard_attr_id': 351, 'fixed_ips': [{'subnet_id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:19Z', 'updated_at': '2021-05-25T15:44:23Z', 'revision_number': 4, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'subnets': [{'id': '06e2e670-b73e-47cd-82bb-dc18be18bd2e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:24.568246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129cc2f5-97e6-416c-a59e-bf7310705639 req-544c5b62-ddc4-4977-87c4-19353861c47e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:24.569748 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-129cc2f5-97e6-416c-a59e-bf7310705639 req-544c5b62-ddc4-4977-87c4-19353861c47e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0905375 May 25 15:44:24.618642 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-129cc2f5-97e6-416c-a59e-bf7310705639 req-d736690d-42b0-46da-bf51-c63a0cfa3f8f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423965 May 25 15:44:25.120409 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baffdc98-d541-4b44-bad8-c21e44fe445f req-6f3a8e99-021d-4dcd-947b-4416d4abcb70 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:25.122389 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-baffdc98-d541-4b44-bad8-c21e44fe445f req-6f3a8e99-021d-4dcd-947b-4416d4abcb70 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1097684 May 25 15:44:25.123769 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-f6a65710-13bf-4bf2-8805-f83f255dcfee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:25.126110 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-f6a65710-13bf-4bf2-8805-f83f255dcfee service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.0804627 May 25 15:44:25.173090 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-baffdc98-d541-4b44-bad8-c21e44fe445f req-4d7d1af7-ab89-4bcf-9a04-c0d3c4628b6b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427527 May 25 15:44:25.328672 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-232b3649-6265-45dd-9f1c-4b051e55090d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:25.330425 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-232b3649-6265-45dd-9f1c-4b051e55090d service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1822083 May 25 15:44:25.520324 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-fc144d6e-c0ff-4153-95b4-4b77d1f57b0d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.0770600 May 25 15:44:25.588337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c96a896c-2be9-475f-882c-2aabf562e20e up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:25.656972 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port c96a896c-2be9-475f-882c-2aabf562e20e completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:25.661666 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port c96a896c-2be9-475f-882c-2aabf562e20e triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:25.662048 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:25.778671 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-30fd2477-65a3-483c-88b2-7942bf17026f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:25.780594 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-30fd2477-65a3-483c-88b2-7942bf17026f service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0653255 May 25 15:44:25.798187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:25.834394 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port c96a896c-2be9-475f-882c-2aabf562e20e, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c96a896c-2be9-475f-882c-2aabf562e20e,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:25.839760 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:25.843404 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:25.879543 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-4984a3f4-aa1e-4847-8450-e28a53c9685c service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0504611 May 25 15:44:25.929686 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:25.933715 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:26.088219 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-361c2625-cd37-45fa-bcb9-61c6c6771edf service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1743331 May 25 15:44:26.298590 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7a4af5df-12ae-4345-b03d-3758fbfd3422 req-7ca2f8f4-25fb-408b-9c61-1b3f35f2daa5 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718085 May 25 15:44:26.386550 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdf1519-5263-4298-82c0-019925a2e25c req-2be70a44-ccd7-4e00-a874-b7e60dff16aa tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:26.393259 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ffdf1519-5263-4298-82c0-019925a2e25c req-2be70a44-ccd7-4e00-a874-b7e60dff16aa tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0967598 May 25 15:44:26.444415 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ffdf1519-5263-4298-82c0-019925a2e25c req-4e058724-a195-4c0e-aa4d-142a97884a10 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499077 May 25 15:44:27.585340 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c96a896c-2be9-475f-882c-2aabf562e20e up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:27.669891 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port c96a896c-2be9-475f-882c-2aabf562e20e triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:27.669891 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.734642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6071199-4426-40eb-91b6-ddbace31335e req-e8a386af-e5da-478b-b6dc-8bdff9dc4089 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:27.736124 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b6071199-4426-40eb-91b6-ddbace31335e req-e8a386af-e5da-478b-b6dc-8bdff9dc4089 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1778457 May 25 15:44:27.782074 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b6071199-4426-40eb-91b6-ddbace31335e req-84854c7f-2f77-4e66-8c56-a6d09c6046fc tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393410 May 25 15:44:29.106865 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-828f2ded-bbb6-41c0-8947-0acb6d5e7336 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.513320 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.672879 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a6a157e9-2382-4530-9299-825c2fdd2a63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.561415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-486f0446-dfbf-42c5-892d-476de7135fbe req-9bcc4b6c-0b88-4b03-b1f2-c2d2d31d0a4b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:32.562955 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-486f0446-dfbf-42c5-892d-476de7135fbe req-9bcc4b6c-0b88-4b03-b1f2-c2d2d31d0a4b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0828683 May 25 15:44:32.610950 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-486f0446-dfbf-42c5-892d-476de7135fbe req-9d24db38-de99-4e3b-84d3-d3c17661548f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421724 May 25 15:44:32.670407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.422528 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:44:34.165409 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a4d5ae-0a8d-47ef-afad-85f5df3f04df req-71b940e0-af91-4f5c-98fe-a357bab445b0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:34.166859 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-49a4d5ae-0a8d-47ef-afad-85f5df3f04df req-71b940e0-af91-4f5c-98fe-a357bab445b0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0809860 May 25 15:44:34.211238 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-49a4d5ae-0a8d-47ef-afad-85f5df3f04df req-8073cc2d-d11b-42b0-a489-9ff5d98da178 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385852 May 25 15:44:34.383429 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.591587 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a4227e-62d0-4991-b64d-ee8b6866a06a req-253129ab-61cf-4dbf-a1fc-d74630b08ba0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:35.594566 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-97a4227e-62d0-4991-b64d-ee8b6866a06a req-253129ab-61cf-4dbf-a1fc-d74630b08ba0 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.1327567 May 25 15:44:35.652350 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-97a4227e-62d0-4991-b64d-ee8b6866a06a req-1b99e88f-2687-4d18-a694-c003775fbf1e tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519001 May 25 15:44:35.682411 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.989092 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-fb54647c-697e-4b5b-a125-2ebc1e5c9322 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0733511 May 25 15:44:36.130002 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-bdf241d4-5661-43db-9e8f-1a5555a26252 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:36.131438 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-bdf241d4-5661-43db-9e8f-1a5555a26252 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1098 time: 0.0743213 May 25 15:44:36.284145 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-c5cf2ec8-a708-4a26-b82a-95f053586440 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:36.285559 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-c5cf2ec8-a708-4a26-b82a-95f053586440 service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.1238897 May 25 15:44:36.398682 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-322547a6-02a4-4d70-a90c-af6b9d539231 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 1001 time: 0.0981116 May 25 15:44:36.487300 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-24551abd-406b-4b74-956f-a4ae33f73da2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:36.488762 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-24551abd-406b-4b74-956f-a4ae33f73da2 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.0590725 May 25 15:44:36.680109 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-1a0a2658-47e6-4cdf-a3a1-c0f15e2abbc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:36.681690 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-1a0a2658-47e6-4cdf-a3a1-c0f15e2abbc1 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1569510 May 25 15:44:36.856206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7c2d04-0c24-4b34-8437-6a7bcbb6822d req-81a4fa70-c9ff-442d-a731-2d5aed388d39 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:36.857633 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-be7c2d04-0c24-4b34-8437-6a7bcbb6822d req-81a4fa70-c9ff-442d-a731-2d5aed388d39 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0824876 May 25 15:44:36.900542 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-81dec30b-343a-4396-b409-f2e3cac093c0 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1614866 May 25 15:44:36.911418 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-be7c2d04-0c24-4b34-8437-6a7bcbb6822d req-1ba27264-3d27-4d0c-9cf1-d3c25f48bb8a tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422394 May 25 15:44:37.057620 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f3af5181-eb5b-4d92-a4a6-bf46add9b3bc req-8d5b606d-156b-47ab-8803-54908b06f3ee service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232066 May 25 15:44:38.120864 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d001d042-b059-48ba-b05f-9d879cfb505d req-2941be56-391c-4f94-9397-4d2087068493 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:38.122305 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d001d042-b059-48ba-b05f-9d879cfb505d req-2941be56-391c-4f94-9397-4d2087068493 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0819712 May 25 15:44:38.174422 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d001d042-b059-48ba-b05f-9d879cfb505d req-c1a7beb0-197b-4b40-ac4b-c3656112b7e2 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458441 May 25 15:44:59.108385 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2b78d44f-fbec-44c3-aa56-ad4d33efc29b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:01.505154 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:01.674187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-89f66b1c-4fc5-4316-baf6-b73010f0d03d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.672395 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:04.387190 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.655834 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:10.421294 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:45:29.110854 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b205512d-abc3-40ae-84b2-31e7dc5f6308 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.508965 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.675541 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-14d49b01-4a0b-4a47-a97f-ee6136f64a87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.674426 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.389191 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.680035 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.878795 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-2872ec56-3717-4045-81cd-b3a423455e5d service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0699780 May 25 15:45:38.013819 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-2691ea1c-1a86-4b42-9792-3ebdc678dba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:38.015443 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-2691ea1c-1a86-4b42-9792-3ebdc678dba0 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1099 time: 0.0763798 May 25 15:45:38.169523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-5261161f-f8fc-43da-a6b0-466611156dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:38.170963 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-5261161f-f8fc-43da-a6b0-466611156dcc service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.1298323 May 25 15:45:38.274215 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-270303e2-ca98-4d80-8a56-3db6ba673f93 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 1002 time: 0.0930183 May 25 15:45:38.343383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-7924e190-41c4-48df-bd08-4f0ee81c89cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:38.344844 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-7924e190-41c4-48df-bd08-4f0ee81c89cd service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.0567398 May 25 15:45:38.432035 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-cdfe26ad-947b-4fb0-8ba3-37b2ce13eeab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:38.433390 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-cdfe26ad-947b-4fb0-8ba3-37b2ce13eeab service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0719011 May 25 15:45:38.567015 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-61581de6-2b75-497c-9c01-60a3cbf43758 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240172 May 25 15:45:38.725173 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-2fb23f0a-e3eb-4d09-a90d-c23b8a9087eb req-c20e710f-b039-4006-8d22-669e6347911b service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1447580 May 25 15:45:47.420090 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:45:59.113823 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-412ce7fa-4096-48ed-98c6-d238c61e4599 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:01.512343 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:01.684463 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-49a231e6-5886-4b85-9c19-f5cb59b5368b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:02.678598 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.391152 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:05.681324 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:24.419145 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:46:29.126178 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-10c68cab-fbff-4bc5-84da-f0031a2f2032 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:31.516254 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:31.676263 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-865151f3-fe3f-4d44-a996-272f053c3d4e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:32.679364 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:34.394087 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:35.690960 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:37.863706 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-4f638b8d-ab8e-4e5e-8abe-56c4bcb9c649 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0690384 May 25 15:46:37.980791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-186b00fa-88f7-4335-8136-0b748b939c1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:37.982256 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-186b00fa-88f7-4335-8136-0b748b939c1d service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.0732312 May 25 15:46:38.133827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-cfbada92-7a01-4210-ad21-b9bf2e571ffd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:38.135146 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-cfbada92-7a01-4210-ad21-b9bf2e571ffd service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1317177 May 25 15:46:38.209083 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-15c32a22-afa9-425b-9142-42540f411ff2 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.0664618 May 25 15:46:38.271653 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-d6e8339e-3c70-442c-8f27-3782e9956198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:38.273072 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-d6e8339e-3c70-442c-8f27-3782e9956198 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0574975 May 25 15:46:38.406653 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-793b4e3a-e84a-4009-b75c-915ce37aba12 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1261604 May 25 15:46:38.539836 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-dc5402d4-2c34-4201-bd76-58cdb24f1682 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240993 May 25 15:46:38.676198 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-fd6b0f9c-e206-43a2-87c5-9906d9e6d3b4 req-705be302-fb7b-4991-b31e-2b12866ffbbf service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293640 May 25 15:46:59.120733 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-426d039f-6e47-48f0-9542-be6350252949 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:01.419166 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:47:01.514448 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:01.675834 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-87c125f2-6bc9-45ac-8111-27b330668e91 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:02.686082 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:04.402590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:05.691393 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:29.124944 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6b3ac6e7-1304-4081-8e7d-3a39190df88e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.524470 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.682634 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-00a0dc6f-1054-4106-a1ab-ab5aa1866c28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.697453 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:34.403664 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:35.715407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:38.007578 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-d8a64018-9c3c-45b8-b765-e3d8767cd6de service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2090063 May 25 15:47:38.189530 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-561acf7f-11e3-48d7-80bf-7c07b683c8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:38.190976 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-561acf7f-11e3-48d7-80bf-7c07b683c8f4 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0799720 May 25 15:47:38.388572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-594107d2-182f-402a-b1f1-47759fc5c311 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:38.390145 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-594107d2-182f-402a-b1f1-47759fc5c311 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1723495 May 25 15:47:38.419727 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:47:38.479684 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-3446bb29-477d-43fe-92d8-10a092e72ed5 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0703440 May 25 15:47:38.547506 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-cc133b6a-dbde-4c10-bd3c-21df3e927400 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:38.548976 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-cc133b6a-dbde-4c10-bd3c-21df3e927400 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0618386 May 25 15:47:38.604433 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-daa8058e-28af-4696-9d7c-e144d01d02d3 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0427868 May 25 15:47:38.751273 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-5f0d341b-f437-4016-8b15-f34856103d1a service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1345067 May 25 15:47:38.896030 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-88e11447-5c83-4aa5-87a8-3a2bffb39c19 req-02884072-ebdb-4f4d-a00f-93db92621639 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1359200 May 25 15:47:59.126435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82ce03ab-37b4-4a56-a5e6-ce70e712e8b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:01.518713 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:01.676282 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f7d138c5-f753-4452-a941-13c402999eae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.687925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:04.404161 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:05.714074 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:15.419837 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:48:29.128449 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-90021c7c-9799-409b-aefa-d6665f4221a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.523396 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.680169 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-093e9c0b-e41f-4527-93be-c152625e9eeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:32.691841 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:34.413653 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:35.719472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.922772 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-e26a10bf-042c-4854-893c-e29e465f95dc service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0963457 May 25 15:48:40.038568 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-cc63d1ca-0bf2-42d2-87f9-b019df5e2797 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:40.040966 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-cc63d1ca-0bf2-42d2-87f9-b019df5e2797 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.0822976 May 25 15:48:40.266961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-ce8fdea5-fcfa-4b4f-bf47-12c31109af6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:40.269439 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-ce8fdea5-fcfa-4b4f-bf47-12c31109af6c service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1954567 May 25 15:48:40.347240 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-94ea0fcb-3583-4d3f-80cb-b6f5c83192cb service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.0695827 May 25 15:48:40.415796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-831d349c-8f26-4f4d-b71f-680d201ef060 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:40.417524 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-831d349c-8f26-4f4d-b71f-680d201ef060 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0635993 May 25 15:48:40.471631 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-97372a16-fe06-48f7-9421-599e712ad287 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0458708 May 25 15:48:40.715389 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-531e5ee6-7fe6-46e0-bf18-6fa3b53d0a63 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2357910 May 25 15:48:40.868768 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-002c3cd4-894e-4cb3-9f81-802e2b83e1f8 req-64f91b6a-f6e2-4205-8bdf-4adbd8377f95 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1435754 May 25 15:48:52.419070 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:48:59.139065 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fac455fc-b936-4729-8ea9-50ce7b063f6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:01.529350 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:01.686756 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7902a1a5-8b6f-4cb0-88ec-614ace7f713a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.696252 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:04.412693 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:05.720447 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:29.132003 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f5c92043-6f1b-4200-8b2c-28bc1546702e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:29.418060 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:49:31.529214 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:31.681097 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d0e6f267-93c5-4846-8662-21490043a65e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.697074 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:34.421123 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:35.718824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:41.876044 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-88f752f1-0ca4-43de-940a-b33c71b84b49 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0858705 May 25 15:49:41.999501 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-dba0aa25-c87c-41d7-bf47-2fccc21533bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.001311 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-dba0aa25-c87c-41d7-bf47-2fccc21533bc service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 1098 time: 0.0861437 May 25 15:49:42.166609 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-22ef0364-d20c-4535-9529-67bd19f7dfc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.168925 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-22ef0364-d20c-4535-9529-67bd19f7dfc9 service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.1467144 May 25 15:49:42.281733 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-52bc2b30-a733-4878-80de-fec886526b1b service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 200 len: 1001 time: 0.1053505 May 25 15:49:42.353113 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-59e54a23-de29-456d-9b11-c21e01c4d76b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.355106 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-59e54a23-de29-456d-9b11-c21e01c4d76b service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.0670922 May 25 15:49:42.454399 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-1cf33cfd-7a0a-4793-9225-5a2f43c1bcf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.455889 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-1cf33cfd-7a0a-4793-9225-5a2f43c1bcf8 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0939505 May 25 15:49:42.592036 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-2664a660-3fdf-45ae-9a42-b7db852db95f service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278269 May 25 15:49:42.733804 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-5ef6dc02-a811-4cd4-8ad7-24af1b37bf60 req-8dafa35d-2030-4153-bb9c-1a332db524c9 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348555 May 25 15:49:59.142802 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-32f85c6f-6076-4f05-8b4b-8bbd3dde4337 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:01.533106 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:01.689336 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1544a80a-109d-480c-b78c-7ae6c2317b05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.705710 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.709195 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 34896) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:02.839426 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.855569 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:02.859731 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Usage tracker for resource:security_group_rule and tenant:3c38b69090a74f1da700bee7f38ff55a is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:02.862581 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:02.868962 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:02.964890 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.970658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.979937 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-28e0fbed-8ac7-46ac-a451-1caee019b81f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.020492 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd4ecbec-4d9f-4ca5-b941-c8e73a6d5b7e,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:03.024557 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3c38b69090a74f1da700bee7f38ff55a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3143239 May 25 15:50:03.028206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 34906) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:03.031532 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.031930 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.032290 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.032644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.032993 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.033367 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.033684 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.034093 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.034427 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.034766 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.035129 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.035511 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.039839 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.093989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.120728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.186980 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.190668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-abd7aa66-7876-4747-abc2-ff2a34c0bcb6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.202499 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd4ecbec-4d9f-4ca5-b941-c8e73a6d5b7e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:03.214008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.214315 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.214512 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.214990 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.215317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.215698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.216048 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.216393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.216738 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.217080 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.217419 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.217759 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:03.220641 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.221753 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/dd4ecbec-4d9f-4ca5-b941-c8e73a6d5b7e HTTP/1.1" status: 204 len: 168 time: 0.1919258 May 25 15:50:03.222655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:04.074842 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 34942) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:04.216522 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-895739745-network', 'tenant_id': 'ef6e18c9984d41f9a3952db092f0e3c8'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:04.221500 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:04.225667 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Usage tracker for resource:network and tenant:ef6e18c9984d41f9a3952db092f0e3c8 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:04.229228 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:04.235755 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:04.257674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Made reservation on behalf of ef6e18c9984d41f9a3952db092f0e3c8 for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:50:04.260987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.273787 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.289115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:04.293326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Usage tracker for resource:security_group_rule and tenant:ef6e18c9984d41f9a3952db092f0e3c8 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:04.296441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:04.302142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:04.411300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.415979 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.417438 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.419091 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-611359f3-fc6a-4178-a37e-4552ce53765f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:04.448653 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] vlan segment allocate from pool success with {'vlan_id': 816, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:50:04.458902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76b89f39-d2ca-40dd-8ff1-330d3224d990,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:04.464305 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:04.465322 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.465668 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Added segment 51c10ea2-0dbc-480a-a608-62cd2596fba8 of type vlan for network 8243927b-fe77-4d86-8b11-a55922605928 May 25 15:50:04.496109 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.538904 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.541475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:04.542090 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.546141 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c032b4a3-3c9b-4c11-861b-d3c90a535eea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:04.653918 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5777991 May 25 15:50:04.654107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 34954) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:04.667701 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Request body: {'subnet': {'network_id': '8243927b-fe77-4d86-8b11-a55922605928', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-895739745-subnet', 'tenant_id': 'ef6e18c9984d41f9a3952db092f0e3c8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:04.684614 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Pushing event updated for resources: {'Network': ['ID=8243927b-fe77-4d86-8b11-a55922605928,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:04.686040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:04.689318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:04.698840 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 8243927b-fe77-4d86-8b11-a55922605928 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:50:04.710892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Usage tracker for resource:subnet and tenant:ef6e18c9984d41f9a3952db092f0e3c8 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:04.716961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:04.725298 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:04.747947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Made reservation on behalf of ef6e18c9984d41f9a3952db092f0e3c8 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:50:04.750676 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.213241 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.217077 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:05.369600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ecf40f71-ad00-492f-859e-f0dffb465329,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:05.374429 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:05.384090 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Checking segment: {'id': '51c10ea2-0dbc-480a-a608-62cd2596fba8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '8243927b-fe77-4d86-8b11-a55922605928'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:50:05.385040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Network hostable DHCP agents. Network: 8243927b-fe77-4d86-8b11-a55922605928, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:50:05.414355 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Network 8243927b-fe77-4d86-8b11-a55922605928 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:50:05.425469 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 8243927b-fe77-4d86-8b11-a55922605928) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:50:05.434989 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13e274c9-531c-4e21-b652-f8cab6892426 None None] Network 8243927b-fe77-4d86-8b11-a55922605928 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:05.436088 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:05.436679 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.485767 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8248646 May 25 15:50:05.656424 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3867a2bf-dc14-444d-aff3-5a5de077bc7a None None] Network 8243927b-fe77-4d86-8b11-a55922605928 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:05.754172 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:06.419041 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:50:24.820059 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35224) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:24.894019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.924370 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.989977 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.994840 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:25.006640 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bcb8a81c-38b2-41dd-9ea6-5358eb8336df,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:25.010495 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:25.014352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:25.015426 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] 10.222.0.25 "DELETE /v2.0/security-groups/bcb8a81c-38b2-41dd-9ea6-5358eb8336df HTTP/1.1" status: 204 len: 168 time: 0.1943927 May 25 15:50:25.115304 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35232) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:25.754838 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:26.245283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Deleting port 61aa8fef-57f0-4938-b812-35122c4cf6b1 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:26.246287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:26.400751 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] For port 61aa8fef-57f0-4938-b812-35122c4cf6b1, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=61aa8fef-57f0-4938-b812-35122c4cf6b1,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:26.401338 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:26.535600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Calling delete_port for 61aa8fef-57f0-4938-b812-35122c4cf6b1 owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:26.842633 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:26.846643 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a092b006-7470-4ed7-a1ef-eb89343c5448 tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:26.892575 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Pushing event deleted for resources: {'Port': ['ID=61aa8fef-57f0-4938-b812-35122c4cf6b1,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:26.896189 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:27.176940 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:27.640316 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Router 10d45808-9326-4631-b06a-49b522151a35 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:27.823679 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:27.832762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] 10.222.0.25 "PUT /v2.0/routers/10d45808-9326-4631-b06a-49b522151a35/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7163010 May 25 15:50:27.833881 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Sync routers for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:27.836003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35270) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:27.845139 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:27.845889 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:28.031008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:28.037639 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:28.229696 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:28.315104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Deleting port 7b28f60d-378b-4a74-bd49-02ec92006c5c {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:28.315366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:28.346119 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136'}], 'enable_snat': True}, 'gw_port_id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:50:26Z', 'revision_number': 5, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port': {'id': '7b28f60d-378b-4a74-bd49-02ec92006c5c', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:34:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10d45808-9326-4631-b06a-49b522151a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.136', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:06Z', 'updated_at': '2021-05-25T15:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:28.350336 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Checking router: 10d45808-9326-4631-b06a-49b522151a35 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:28.359380 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Routers {'10d45808-9326-4631-b06a-49b522151a35'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:28.360077 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['10d45808-9326-4631-b06a-49b522151a35'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:28.440857 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] For port 7b28f60d-378b-4a74-bd49-02ec92006c5c, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=7b28f60d-378b-4a74-bd49-02ec92006c5c,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:28.441233 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:28.544315 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] Set router 10d45808-9326-4631-b06a-49b522151a35 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:28.581093 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Calling delete_port for 7b28f60d-378b-4a74-bd49-02ec92006c5c owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:28.720773 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:50:28Z', 'revision_number': 6, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:28.727814 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14f2b4f1-018e-4d07-98ed-36e559d01ff3 None None] The sync data for ids ['10d45808-9326-4631-b06a-49b522151a35'] in dv-cinder-786383-6-iscsi is: [{'id': '10d45808-9326-4631-b06a-49b522151a35', 'name': 'tempest-TestShelveInstance-1178954393-router', 'tenant_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:05Z', 'updated_at': '2021-05-25T15:50:28Z', 'revision_number': 6, 'project_id': '36a8e64d79d14b1bbc49f2fc6ee6efef', 'gw_port_host': None}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:28.730425 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:28.734510 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.869527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b28f60d-378b-4a74-bd49-02ec92006c5c,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:28.872575 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.960383 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.147800 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.151849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.152500 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-910e945d-febf-4905-9108-c4e335505dc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.250758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.251272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 10d45808-9326-4631-b06a-49b522151a35 {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:50:29.265350 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.266480 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] 10.222.0.25 "DELETE /v2.0/routers/10d45808-9326-4631-b06a-49b522151a35 HTTP/1.1" status: 204 len: 168 time: 1.4295588 May 25 15:50:29.272170 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35288) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:29.366488 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Deleting subnet 3d39e59e-789e-4e2f-8d7b-d42051f9d502 {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:50:29.371342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.430030 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.598953 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.825625 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 61aa8fef-57f0-4938-b812-35122c4cf6b1 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:29.863372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 61aa8fef-57f0-4938-b812-35122c4cf6b1 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:29.863768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 61aa8fef-57f0-4938-b812-35122c4cf6b1 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:29.864212 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 7b28f60d-378b-4a74-bd49-02ec92006c5c no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:29.909030 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 7b28f60d-378b-4a74-bd49-02ec92006c5c {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:29.909628 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 7b28f60d-378b-4a74-bd49-02ec92006c5c not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:29.953573 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:29.960388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:30.000768 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3d39e59e-789e-4e2f-8d7b-d42051f9d502,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:30.002899 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.007256 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb1bf3de-4ab3-485d-881b-e8a5a7382e60 None None] Network 766a97d7-d18b-48a7-bf13-6371007ad277 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:30.012464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:30.020015 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-42c47288-e067-4ee4-8ba3-0e576d898e98 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/3d39e59e-789e-4e2f-8d7b-d42051f9d502 HTTP/1.1" status: 204 len: 168 time: 0.7417884 May 25 15:50:30.020015 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35302) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:30.208483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.288915 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Deleting port 1e859884-3874-48e0-8b1b-36e5d92d44e6 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:30.289301 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.306667 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] DHCP port deletion for 766a97d7-d18b-48a7-bf13-6371007ad277 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:50:30.380332 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Deleting port 1e859884-3874-48e0-8b1b-36e5d92d44e6 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:30.380818 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.411455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] For port 1e859884-3874-48e0-8b1b-36e5d92d44e6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1e859884-3874-48e0-8b1b-36e5d92d44e6,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:30.411876 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.570649 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Calling delete_port for 1e859884-3874-48e0-8b1b-36e5d92d44e6 owned by network:dhcp {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:30.624696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] For port 1e859884-3874-48e0-8b1b-36e5d92d44e6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1e859884-3874-48e0-8b1b-36e5d92d44e6,segment=NetworkSegment(d5529774-91f8-48d1-babd-bb3f655c1d53),segment_id=d5529774-91f8-48d1-babd-bb3f655c1d53)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:30.625319 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.636237 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.641352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e022009c-8008-4a20-bb9c-7ff0e7bb85f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:30.785017 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Pushing event deleted for resources: {'Port': ['ID=1e859884-3874-48e0-8b1b-36e5d92d44e6,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:30.787592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:30.790302 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] No DVR routers for this DVR port 1e859884-3874-48e0-8b1b-36e5d92d44e6 on host dv-cinder-786383-6-iscsi {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:30.811380 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Calling delete_port for 1e859884-3874-48e0-8b1b-36e5d92d44e6 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:30.916380 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.932321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['766a97d7-d18b-48a7-bf13-6371007ad277']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:30.946706 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd5529774-91f8-48d1-babd-bb3f655c1d53') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:30.947328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd5529774-91f8-48d1-babd-bb3f655c1d53') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:30.960267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.966067 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.970122 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:30.978793 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.985728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Releasing vlan 815 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:50:30.986157 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:50:31.004475 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:50:31.018793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Pushing event deleted for resources: {'Port': ['ID=1e859884-3874-48e0-8b1b-36e5d92d44e6,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:31.030117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] No DVR routers for this DVR port 1e859884-3874-48e0-8b1b-36e5d92d44e6 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:31.032158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.032506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.032844 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.033177 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.033503 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.033833 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.034156 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.034480 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.034804 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.035125 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.035444 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.035795 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:31.039090 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:31.089541 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.093750 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:31.107344 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.118226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Pushing event deleted for resources: {'Network': ['ID=766a97d7-d18b-48a7-bf13-6371007ad277,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:31.121352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:31.125212 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] 10.222.0.25 "DELETE /v2.0/networks/766a97d7-d18b-48a7-bf13-6371007ad277 HTTP/1.1" status: 204 len: 168 time: 1.1036952 May 25 15:50:31.128067 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35316) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:31.531311 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.687203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a543dd0-a1a7-4138-9dec-a52259ebe4d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.795414 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.807312 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1e859884-3874-48e0-8b1b-36e5d92d44e6 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:31.845181 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 1e859884-3874-48e0-8b1b-36e5d92d44e6 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:31.845634 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1e859884-3874-48e0-8b1b-36e5d92d44e6 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:32.315457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Deleting port c96a896c-2be9-475f-882c-2aabf562e20e {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:32.316130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:32.550833 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] For port c96a896c-2be9-475f-882c-2aabf562e20e, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c96a896c-2be9-475f-882c-2aabf562e20e,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:32.551102 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:32.677257 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Calling delete_port for c96a896c-2be9-475f-882c-2aabf562e20e owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:32.714007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:32.876560 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:32.880481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:32.928610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Pushing event deleted for resources: {'Port': ['ID=c96a896c-2be9-475f-882c-2aabf562e20e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:32.933115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:33.241220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:33.637388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Router f81a3f6c-a0d3-4fbf-98f5-79256552200b has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:33.892211 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:33.902751 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] 10.222.0.25 "PUT /v2.0/routers/f81a3f6c-a0d3-4fbf-98f5-79256552200b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7733555 May 25 15:50:33.905413 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35360) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:33.907598 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Sync routers for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:33.934834 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:33.936281 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:34.178340 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:34.255832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.461173 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.490122 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.569049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Deleting port a84350f2-53bf-4f19-95c7-f9ac0a8772e3 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:34.569394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.608626 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231'}], 'enable_snat': True}, 'gw_port_id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:50:32Z', 'revision_number': 5, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port': {'id': 'a84350f2-53bf-4f19-95c7-f9ac0a8772e3', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:b8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:15Z', 'updated_at': '2021-05-25T15:44:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:34.614868 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Checking router: f81a3f6c-a0d3-4fbf-98f5-79256552200b for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:34.627514 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Routers {'f81a3f6c-a0d3-4fbf-98f5-79256552200b'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:34.628492 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:34.704289 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] For port a84350f2-53bf-4f19-95c7-f9ac0a8772e3, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:34.704881 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.842097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Calling delete_port for a84350f2-53bf-4f19-95c7-f9ac0a8772e3 owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:34.861605 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] Set router f81a3f6c-a0d3-4fbf-98f5-79256552200b gateway port host: None {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:34.970863 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:50:34Z', 'revision_number': 6, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:34.975201 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47451d22-5d85-4341-bacb-5438a3c67a79 None None] The sync data for ids ['f81a3f6c-a0d3-4fbf-98f5-79256552200b'] in dv-cinder-786383-6-iscsi is: [{'id': 'f81a3f6c-a0d3-4fbf-98f5-79256552200b', 'name': 'tempest-TestShelveInstance-888784765-router', 'tenant_id': 'f0a47009ab974064b83bafb40da198fb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:14Z', 'updated_at': '2021-05-25T15:50:34Z', 'revision_number': 6, 'project_id': 'f0a47009ab974064b83bafb40da198fb', 'gw_port_host': None}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:34.991610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:34.996891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-14a02272-35fe-4bb7-bb6f-c15cfea2ee43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.043676 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=a84350f2-53bf-4f19-95c7-f9ac0a8772e3,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:35.069003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.139204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.318349 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.320620 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.352921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.353847 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f81a3f6c-a0d3-4fbf-98f5-79256552200b {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:50:35.376914 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.378969 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] 10.222.0.25 "DELETE /v2.0/routers/f81a3f6c-a0d3-4fbf-98f5-79256552200b HTTP/1.1" status: 204 len: 168 time: 1.4718475 May 25 15:50:35.380998 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35382) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:35.457546 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Deleting subnet 06e2e670-b73e-47cd-82bb-dc18be18bd2e {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:50:35.460827 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.518112 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.614246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.735633 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.888208 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c96a896c-2be9-475f-882c-2aabf562e20e no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:35.972403 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: c96a896c-2be9-475f-882c-2aabf562e20e {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:35.973009 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c96a896c-2be9-475f-882c-2aabf562e20e not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:35.973143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device a84350f2-53bf-4f19-95c7-f9ac0a8772e3 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:36.012053 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: a84350f2-53bf-4f19-95c7-f9ac0a8772e3 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:36.012656 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device a84350f2-53bf-4f19-95c7-f9ac0a8772e3 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:36.016142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.022954 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-641dccf0-dc32-4f53-b85e-ed4c10529343 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:36.064606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.069136 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06e2e670-b73e-47cd-82bb-dc18be18bd2e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:36.072552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:36.077662 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c94b93e0-2ec1-47e6-a346-7b4c940e9868 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/06e2e670-b73e-47cd-82bb-dc18be18bd2e HTTP/1.1" status: 204 len: 168 time: 0.6932065 May 25 15:50:36.079406 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35396) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:36.081329 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46f6b7ee-0dc3-480e-a676-e2a737e847eb None None] Network 876389b2-0a69-4c25-a66f-a8a53f772943 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:36.257223 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.334869 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Deleting port 9688f604-230e-4cea-b407-06e7ca818213 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:36.335195 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.389845 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] DHCP port deletion for 876389b2-0a69-4c25-a66f-a8a53f772943 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:50:36.465090 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] For port 9688f604-230e-4cea-b407-06e7ca818213, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9688f604-230e-4cea-b407-06e7ca818213,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:36.465468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.465882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Deleting port 9688f604-230e-4cea-b407-06e7ca818213 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:36.466373 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.576215 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] For port 9688f604-230e-4cea-b407-06e7ca818213, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=9688f604-230e-4cea-b407-06e7ca818213,segment=NetworkSegment(e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af),segment_id=e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:36.576612 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.660867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Calling delete_port for 9688f604-230e-4cea-b407-06e7ca818213 owned by network:dhcp {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:36.726321 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Calling delete_port for 9688f604-230e-4cea-b407-06e7ca818213 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:36.792234 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.800446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:36.804250 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.809730 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:36.858602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Pushing event deleted for resources: {'Port': ['ID=9688f604-230e-4cea-b407-06e7ca818213,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:36.861788 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:36.862627 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] No DVR routers for this DVR port 9688f604-230e-4cea-b407-06e7ca818213 on host dv-cinder-786383-6-iscsi {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:36.878335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Pushing event deleted for resources: {'Port': ['ID=9688f604-230e-4cea-b407-06e7ca818213,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:36.883901 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:36.884787 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] No DVR routers for this DVR port 9688f604-230e-4cea-b407-06e7ca818213 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:36.992633 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.008321 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['876389b2-0a69-4c25-a66f-a8a53f772943']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:37.031482 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:37.031812 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e14cbe3a-c261-4fb6-aa58-3a1fe83eb0af') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:37.044712 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.065044 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.075468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Releasing vlan 821 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:50:37.076089 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: util.warn( May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: util.warn( May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: util.warn( May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: util.warn( May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:50:37.090588 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:50:37.170053 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.173811 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:37.187574 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.199189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Pushing event deleted for resources: {'Network': ['ID=876389b2-0a69-4c25-a66f-a8a53f772943,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:37.204156 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] 10.222.0.25 "DELETE /v2.0/networks/876389b2-0a69-4c25-a66f-a8a53f772943 HTTP/1.1" status: 204 len: 168 time: 1.1227248 May 25 15:50:37.205884 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:37.363912 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35414) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:37.434530 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-1122cdd7-9f93-4d4b-9046-6088e61b6d00 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=36a8e64d79d14b1bbc49f2fc6ee6efef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0662527 May 25 15:50:37.435140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35420) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:37.521665 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.553813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.635466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.639959 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e5fe3d52-7009-4f99-8d97-0359d4cb4ff6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:37.654761 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4251fe3-9b3d-448a-8c8c-225e9729fc9f,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:37.658422 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:37.661071 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.665866 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e4251fe3-9b3d-448a-8c8c-225e9729fc9f HTTP/1.1" status: 204 len: 168 time: 0.2241366 May 25 15:50:37.847632 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9688f604-230e-4cea-b407-06e7ca818213 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:37.893793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 9688f604-230e-4cea-b407-06e7ca818213 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:37.894335 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 9688f604-230e-4cea-b407-06e7ca818213 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:38.138380 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35436) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:38.221223 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-cfd1ca38-934d-401d-bb5b-a045d6a25497 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f0a47009ab974064b83bafb40da198fb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0811627 May 25 15:50:38.225283 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35440) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:38.312256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:38.339188 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:38.399397 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:38.404434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-495878f4-c289-42bc-a717-ea8fd8d6662b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:38.417467 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=378f42c2-c243-451a-a096-beef12da50c7,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:38.421072 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:38.422978 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:38.426852 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/378f42c2-c243-451a-a096-beef12da50c7 HTTP/1.1" status: 204 len: 168 time: 0.1971569 May 25 15:50:42.890447 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-1c6e1e78-b971-44d5-943b-3bfebe90f3a7 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0877199 May 25 15:50:43.029624 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-8e20b8ff-c361-43cd-aec9-286a3a6ef6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.031082 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-8e20b8ff-c361-43cd-aec9-286a3a6ef6f4 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 1099 time: 0.0865047 May 25 15:50:43.201530 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-c25032a5-d99d-437a-b0b1-568c2122d902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.202900 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-c25032a5-d99d-437a-b0b1-568c2122d902 service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.1484945 May 25 15:50:43.398268 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-f397e119-7be3-477a-b05c-ed7bdc402df1 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 200 len: 1002 time: 0.1874397 May 25 15:50:43.424873 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:50:43.467901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-a1c01a85-5c37-4257-a231-51d050c2a854 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.469371 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-a1c01a85-5c37-4257-a231-51d050c2a854 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.0640576 May 25 15:50:43.550111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-ae2e9c47-4d82-46b1-8213-82b20205c54d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.551603 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-ae2e9c47-4d82-46b1-8213-82b20205c54d service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0739727 May 25 15:50:43.688758 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-20571151-51cc-455c-be29-9b2ef3dce594 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293066 May 25 15:50:43.842375 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-739e2aa9-d47e-4958-84bf-89831f994e2d req-79c88f39-e172-4ed1-9e22-636a501aaf80 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434469 May 25 15:50:47.256045 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333f79a5-470f-40ad-8b91-e3707f263f3c req-254075f8-d446-459a-bfcf-a7b134a1c49a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:47.257552 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-333f79a5-470f-40ad-8b91-e3707f263f3c req-254075f8-d446-459a-bfcf-a7b134a1c49a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.0962737 May 25 15:50:47.306155 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-333f79a5-470f-40ad-8b91-e3707f263f3c req-ff9193c6-9293-4f88-a390-c776c14436b8 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414793 May 25 15:50:47.958052 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-63d6e99b-9424-4691-8d1b-dc2db8b1ad62 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:47.958714 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-63d6e99b-9424-4691-8d1b-dc2db8b1ad62 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Synchronizing usage tracker for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:47.978841 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-63d6e99b-9424-4691-8d1b-dc2db8b1ad62 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Unset dirty status for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:47.980035 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-63d6e99b-9424-4691-8d1b-dc2db8b1ad62 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 946 time: 0.1081741 May 25 15:50:48.137430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Deleting port 4db5be42-79ac-4400-b3f9-ff41ef933d17 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:48.137773 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.289314 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] For port 4db5be42-79ac-4400-b3f9-ff41ef933d17, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=4db5be42-79ac-4400-b3f9-ff41ef933d17,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:48.289678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.681166 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.681881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.682496 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.l3_db [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Floating IP 01b3f2a3-f643-46f9-b308-8bf7a8b4f106 disassociated. External IP: 172.27.1.232, port: 4db5be42-79ac-4400-b3f9-ff41ef933d17. May 25 15:50:48.683072 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Calling delete_port for 4db5be42-79ac-4400-b3f9-ff41ef933d17 owned by compute:nova {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:48.844794 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.851778 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c3-6105-42ea-9c62-4db9c6e5e88e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:48.903249 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'Port': ['ID=4db5be42-79ac-4400-b3f9-ff41ef933d17,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:48.907520 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14925e5-69fb-4ba1-a822-9fe4ef7e1dab req-29b79e93-130f-484e-98a6-13b29f4e9c66 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:48.909772 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f14925e5-69fb-4ba1-a822-9fe4ef7e1dab req-29b79e93-130f-484e-98a6-13b29f4e9c66 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 867 time: 0.4513688 May 25 15:50:48.911700 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:48.979091 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f14925e5-69fb-4ba1-a822-9fe4ef7e1dab req-f455e3b6-ccd5-4eb6-90cd-0bb6f3b12671 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0556395 May 25 15:50:49.166513 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:49.594217 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:49.606990 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:49.621045 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:49.621953 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:49.682031 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] No DVR routers for this DVR port 4db5be42-79ac-4400-b3f9-ff41ef933d17 on host hv-cinder-78638 {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:49.686853 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:49.689616 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'name': 'network-vif-deleted', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:49.719342 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-96afcfb9-faff-4e3d-8f7f-8797557975e3 req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "DELETE /v2.0/ports/4db5be42-79ac-4400-b3f9-ff41ef933d17 HTTP/1.1" status: 204 len: 173 time: 1.7326159 May 25 15:50:49.910710 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:49.916181 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59', 'name': 'network-vif-deleted', 'tag': '4db5be42-79ac-4400-b3f9-ff41ef933d17', 'status': 'completed', 'code': 200} May 25 15:50:50.204532 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-df83468d-e366-43c6-bf7a-55054d9f5388 req-c6b7a4ae-acd2-4c8d-a6cd-a75b7bea6fa6 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=3ed9e48c-dced-4a1d-a0d8-b8ccc89f3d59 HTTP/1.1" status: 200 len: 210 time: 0.0432863 May 25 15:50:50.387260 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:50.392160 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:50.405477 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:50.406114 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:50.648322 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:51.008973 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:51.013533 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0476a7a0-e4ad-43b6-ac34-ae98831f3291 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:51.296488 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a5cbeb5-7300-4804-b5eb-a539a1ce4b36 None None] New status for floating IP 01b3f2a3-f643-46f9-b308-8bf7a8b4f106: DOWN {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:50:51.370372 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35606) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:51.440179 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.471741 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.539877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.546951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2bfb798f-060d-4a24-b9ab-faa4e4942b87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:51.562068 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:51.565095 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:51.567096 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.568462 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "DELETE /v2.0/security-groups/5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded HTTP/1.1" status: 204 len: 168 time: 0.1969810 May 25 15:50:51.573100 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35610) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:51.595241 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.api.v2.resource [None req-fc434ecd-34d8-48fc-96cb-bb6763a92f75 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] show failed (client error): The resource could not be found. May 25 15:50:51.596490 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-fc434ecd-34d8-48fc-96cb-bb6763a92f75 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups/5eb01469-c4e5-4d1b-ae6a-0c09e8de8ded HTTP/1.1" status: 404 len: 347 time: 0.0216677 May 25 15:50:51.599073 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35614) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:51.674698 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 4db5be42-79ac-4400-b3f9-ff41ef933d17 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:51.718365 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 4db5be42-79ac-4400-b3f9-ff41ef933d17 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:51.719242 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 4db5be42-79ac-4400-b3f9-ff41ef933d17 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:51.823062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Deleting port 48fdd9f0-791c-40da-bbfa-08a554d91e18 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:51.823437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.957262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.957611 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.129539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Calling delete_port for 48fdd9f0-791c-40da-bbfa-08a554d91e18 owned by network:floatingip {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:52.278765 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.282536 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:52.327112 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'Port': ['ID=48fdd9f0-791c-40da-bbfa-08a554d91e18,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:52.330274 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:52.425757 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.439732 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.440843 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-df41cca4-4db2-41e3-b236-e805cce6a255 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "DELETE /v2.0/floatingips/01b3f2a3-f643-46f9-b308-8bf7a8b4f106 HTTP/1.1" status: 204 len: 168 time: 0.8408446 May 25 15:50:52.981798 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35634) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:52.981798 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group': {'name': 'tempest-securitygroup--428679168', 'description': 'tempest-description--289507507'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:52.987367 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:52.991493 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:52.995275 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:53.001327 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:53.012563 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.034181 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:53.038505 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:53.042039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:53.048214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:53.131739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.136827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.140744 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-500c1dfa-22d5-4870-9c73-5e324444c95b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:53.181020 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:53.184552 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:53.188748 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.190889 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.2143431 May 25 15:50:53.193486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35640) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:53.202578 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group_rule': {'security_group_id': 'cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:53.209202 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:53.214166 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:53.217107 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:53.222764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:53.243711 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.310728 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.314977 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.317733 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-96dd273a-68ef-4402-bb8b-abda85d92a73 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:53.342200 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38dfb0d4-bdb9-416b-b425-b89fc23bf736,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:53.346717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:53.356193 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.357266 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1621649 May 25 15:50:53.365808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35646) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:53.372054 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'security_group_rule': {'security_group_id': 'cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:53.378640 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:53.385287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:security_group_rule and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:53.389002 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:53.397009 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:53.421521 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.513640 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.519200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.522403 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:53.546897 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2134f0f9-892e-44c3-9945-a21d5ac85646,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:53.549835 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:53.559341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.561045 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1936917 May 25 15:50:53.565871 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35652) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:53.574986 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:53.584097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:53.589186 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:floatingip and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:53.592083 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:53.597877 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:53.611385 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.757213 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:53.898934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Allocated IP 172.27.1.235 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/a6c40530-75a7-4fa0-b1aa-e95fd6651d03) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:50:54.051693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.083449 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.088288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:54.157340 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:50:54.162606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:50:54.166736 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:50:54.197004 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=a6c40530-75a7-4fa0-b1aa-e95fd6651d03,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:54.202812 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:54.258862 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.354627 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.582020 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.588527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.594265 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f63e7a1c-09f4-4a92-8075-d2e6f9ff46b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:54.702040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=a6c40530-75a7-4fa0-b1aa-e95fd6651d03,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:54.706190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:54.714387 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.739792 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.741356 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1740193 May 25 15:50:54.974157 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-4713a0bc-a79d-461b-8138-f53e4f018b49 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--428679168&fields=id&tenant_id=dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 267 time: 0.0423055 May 25 15:50:55.128682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-37560258-7a55-4546-a08c-70f8bca1bb82 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:55.130023 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-37560258-7a55-4546-a08c-70f8bca1bb82 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 817 time: 0.1477106 May 25 15:50:55.147762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-0e88d56a-5795-46e8-acd7-8543b531e2f5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/quotas/dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 375 time: 0.0099607 May 25 15:50:55.233545 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-753917ef-2471-45c7-b910-6c907389f247 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0795619 May 25 15:50:55.522156 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-ff94c0e6-50e0-40c5-9cc6-48abcd4433e1 service neutron] 10.222.0.25 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2752800 May 25 15:50:55.683449 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-926d064f-fedc-4868-9ed3-d5f9ed6d7156 service neutron] 10.222.0.25 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1483433 May 25 15:50:55.858220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642ea3ca-acc7-47ea-bd9a-17013b0d83c4 req-cca31c5f-c7f5-478c-b7d7-c9606e5247b2 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:55.860458 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-642ea3ca-acc7-47ea-bd9a-17013b0d83c4 req-cca31c5f-c7f5-478c-b7d7-c9606e5247b2 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.1191583 May 25 15:50:55.925329 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6a1f7d3-00ab-4d1a-b9b9-424c286d1a33 req-36489864-1ada-49d6-b6b5-9fba59cca745 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 210 time: 0.0605919 May 25 15:50:55.949283 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-642ea3ca-acc7-47ea-bd9a-17013b0d83c4 req-d14bcbcc-9789-4bfd-95f7-e9d4c3e855b4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529873 May 25 15:50:56.535349 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-a246a319-27d4-40e4-9b43-ce62aa64f3df tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:56.536222 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-a246a319-27d4-40e4-9b43-ce62aa64f3df tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:56.561235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-a246a319-27d4-40e4-9b43-ce62aa64f3df tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:56.563533 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-a246a319-27d4-40e4-9b43-ce62aa64f3df tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.1129715 May 25 15:50:56.758220 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Deleting port fc98b49d-704b-4dfb-bedd-e8a999ed769b {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:56.758768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:57.014281 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] For port fc98b49d-704b-4dfb-bedd-e8a999ed769b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fc98b49d-704b-4dfb-bedd-e8a999ed769b,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:57.014281 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:57.222332 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-167c2dca-7c6a-49ba-a861-f7d2ccba369d req-cd51f569-0952-455d-9c89-b0d7b9714e9b tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 210 time: 0.1485777 May 25 15:50:57.292550 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be98ddd6-f706-4653-aa51-b908f361ea26 req-45ed477f-4daf-422f-9594-c5dd582e6dc9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:57.294230 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-be98ddd6-f706-4653-aa51-b908f361ea26 req-45ed477f-4daf-422f-9594-c5dd582e6dc9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 945 time: 0.1456907 May 25 15:50:57.357011 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-be98ddd6-f706-4653-aa51-b908f361ea26 req-fcf5c9e5-bdcb-4a32-a6d3-de03fb7ecd70 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=ded7460c-4a06-481d-9879-887b2520ce54&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0560665 May 25 15:50:57.381030 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:57.381481 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:57.381907 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.l3_db [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Floating IP e0e23f1b-e60a-4257-881a-d0c6cf4e4300 disassociated. External IP: 172.27.1.100, port: fc98b49d-704b-4dfb-bedd-e8a999ed769b. May 25 15:50:57.382371 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Calling delete_port for fc98b49d-704b-4dfb-bedd-e8a999ed769b owned by compute:nova {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:57.547009 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:57.558797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27067867-c448-4be1-9973-1b972232a973 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:57.641500 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'Port': ['ID=fc98b49d-704b-4dfb-bedd-e8a999ed769b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:57.645270 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:57.781574 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-8e8fa13c-ba84-4c4c-828c-3f315fa42d8f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:57.784575 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-8e8fa13c-ba84-4c4c-828c-3f315fa42d8f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 817 time: 0.2854149 May 25 15:50:57.869549 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:57.885629 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-69ff11e2-aba0-40c9-9f68-8a6bd3b65836 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dd09b4c567df401194ac3825fe2e3080 HTTP/1.1" status: 200 len: 379 time: 0.0601730 May 25 15:50:57.895946 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'port': {'device_id': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'admin_state_up': True, 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'security_groups': ['cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:58.047103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:58.051506 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Usage tracker for resource:port and tenant:dd09b4c567df401194ac3825fe2e3080 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:58.054476 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:58.061026 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:58.073961 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Made reservation on behalf of dd09b4c567df401194ac3825fe2e3080 for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:50:58.076496 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:58.079438 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:58.088402 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:58.099490 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:58.100512 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:58.164131 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] No DVR routers for this DVR port fc98b49d-704b-4dfb-bedd-e8a999ed769b on host hv-cinder-78638 {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:58.167528 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:58.170307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'name': 'network-vif-deleted', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:58.188332 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a3368ef6-ff38-407a-9549-ad72dda44349 req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "DELETE /v2.0/ports/fc98b49d-704b-4dfb-bedd-e8a999ed769b HTTP/1.1" status: 204 len: 173 time: 1.6186528 May 25 15:50:58.231025 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8fef1c84-f6b0-4eda-b704-8cf61b0b268f', 'name': 'network-vif-deleted', 'tag': 'fc98b49d-704b-4dfb-bedd-e8a999ed769b', 'status': 'completed', 'code': 200} May 25 15:50:58.279916 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Allocated IP 172.20.0.12 (f2d88153-7a7c-4433-8f94-c27a6e5feb07/139c7c04-45f8-44c4-90ec-3068f09f624c/3c24e981-4263-4e26-8e3f-289dd52b4ad8) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:50:58.357553 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:58.467786 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f74afa0a-cf0f-40de-851f-c92a851e2ab5 req-2111080a-d872-4b12-a105-27c286dee7f4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 210 time: 0.0484726 May 25 15:50:58.613974 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6dce7a9c-6cb5-4072-aa6b-f97d8f306f37 req-159ee943-ea2d-44af-816f-b717f7ace591 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=8fef1c84-f6b0-4eda-b704-8cf61b0b268f HTTP/1.1" status: 200 len: 210 time: 0.0549996 May 25 15:50:58.622179 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:58.638669 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Transition to ACTIVE for port object 3c24e981-4263-4e26-8e3f-289dd52b4ad8 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:50:58.664079 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:58.670503 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:58.740963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:50:58.744967 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:50:58.745212 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:58.749495 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:50:58.750438 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:58.760729 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:58.761545 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:50:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:58.787816 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event updated for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:58.793039 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:58.829618 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:58.830280 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:58.867633 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9755521 May 25 15:50:58.903225 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Request body: {'port': {'device_id': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:58.999018 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:59.052538 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.094883 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-375b5fbf-d368-4471-af3a-73bdbb10833c None None] Provisioning for port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:50:59.102822 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-375b5fbf-d368-4471-af3a-73bdbb10833c None None] Provisioning complete for port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:50:59.103761 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-375b5fbf-d368-4471-af3a-73bdbb10833c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.193667 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a8d994e2-eeda-4910-987c-b2474084b17a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.203108 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-375b5fbf-d368-4471-af3a-73bdbb10833c None None] Port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:50:59.386996 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:59.391697 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e011d64-e7da-4cde-b2eb-ef75f95c5fa2 None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:59.528771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3c24e981-4263-4e26-8e3f-289dd52b4ad8 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:50:59.537018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.554665 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Transition to ACTIVE for port object 3c24e981-4263-4e26-8e3f-289dd52b4ad8 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:50:59.562759 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.572606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:59.705755 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fc98b49d-704b-4dfb-bedd-e8a999ed769b no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:59.803962 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35756) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:59.813057 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2919ae6b-14b7-47b5-8fbc-14bec7d23535 None None] New status for floating IP e0e23f1b-e60a-4257-881a-d0c6cf4e4300: DOWN {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:50:59.862726 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Pushing event updated for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:59.891692 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:59.915359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.946295 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: fc98b49d-704b-4dfb-bedd-e8a999ed769b {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:59.946646 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fc98b49d-704b-4dfb-bedd-e8a999ed769b not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:59.948099 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Attempting to bind port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:50:59.948245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Attempting to bind port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:50:59.948475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Attempting to bind port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:50:59.959971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fdb9d9-136b-4710-9be1-93307786d648 req-63fed52c-8b71-4eff-ae67-7abc2584f1b2 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:59.960711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-30fdb9d9-136b-4710-9be1-93307786d648 req-63fed52c-8b71-4eff-ae67-7abc2584f1b2 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Synchronizing usage tracker for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:59.967025 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:50:59.967342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Attempting to bind port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 on network f2d88153-7a7c-4433-8f94-c27a6e5feb07 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:50:59.973189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.979305 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 50, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:50:59.979662 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Checking segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:50:59.980049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Bound using segment: {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:50:59.980484 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Bound port: 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:50:59.980833 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:59.998589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-30fdb9d9-136b-4710-9be1-93307786d648 req-63fed52c-8b71-4eff-ae67-7abc2584f1b2 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Unset dirty status for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:59.999779 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-30fdb9d9-136b-4710-9be1-93307786d648 req-63fed52c-8b71-4eff-ae67-7abc2584f1b2 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 944 time: 0.2639689 May 25 15:51:00.049861 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.055285 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-98db99a1-068e-414c-8035-a7c63652c9da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:00.071623 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ded7460c-4a06-481d-9879-887b2520ce54,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:00.084737 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:00.091602 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.092979 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "DELETE /v2.0/security-groups/ded7460c-4a06-481d-9879-887b2520ce54 HTTP/1.1" status: 204 len: 168 time: 0.2873540 May 25 15:51:00.095824 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35762) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:00.113478 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.api.v2.resource [None req-6c224077-6133-4e6c-9f31-4902415a5d22 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] show failed (client error): The resource could not be found. May 25 15:51:00.114963 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6c224077-6133-4e6c-9f31-4902415a5d22 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups/ded7460c-4a06-481d-9879-887b2520ce54 HTTP/1.1" status: 404 len: 347 time: 0.0182295 May 25 15:51:00.118013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35766) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:00.142089 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-30fdb9d9-136b-4710-9be1-93307786d648 req-7884b631-d23b-4c96-851c-1a36ed8e6f2e tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1124358 May 25 15:51:00.168388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:51:00.172321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:51:00.183214 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.187530 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:00.248386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:00.249158 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.250541 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] 10.222.0.74 "PUT /v2.0/ports/3c24e981-4263-4e26-8e3f-289dd52b4ad8 HTTP/1.1" status: 200 len: 1094 time: 1.3543224 May 25 15:51:00.251064 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:00.288514 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Pushing event updated for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:00.292892 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:00.396571 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'status': 'completed', 'code': 200} May 25 15:51:00.420794 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-0c97ef22-61d3-448d-a64d-e2633527cb0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:00.422330 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-0c97ef22-61d3-448d-a64d-e2633527cb0a service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 1097 time: 0.0983417 May 25 15:51:00.436792 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Deleting port af349efd-a083-4d04-bc3d-bcce005d9daf {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:51:00.437168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.520756 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-1ebfc2ad-285e-4a6b-9b5b-638e0416e51a service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8 HTTP/1.1" status: 200 len: 217 time: 0.0826116 May 25 15:51:00.598634 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-ad702ace-6366-4b68-91a9-57071a505705 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:00.600292 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-ad702ace-6366-4b68-91a9-57071a505705 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.0720890 May 25 15:51:00.699768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.700050 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-6f97c66c-f880-4a2b-b4de-c49087079942 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:00.700167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:00.700264 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-6f97c66c-f880-4a2b-b4de-c49087079942 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0873027 May 25 15:51:00.834657 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-57bff637-0422-4e98-a37d-33f5f29aac05 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1302931 May 25 15:51:00.904621 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Calling delete_port for af349efd-a083-4d04-bc3d-bcce005d9daf owned by network:floatingip {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:51:00.979734 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b734f66f-1c6f-4dd2-add6-7b68bf9566d8 req-f84df57c-0b49-4654-ae8b-fd099c93aac5 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1369610 May 25 15:51:01.027822 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.031460 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:01.075807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'Port': ['ID=af349efd-a083-4d04-bc3d-bcce005d9daf,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:01.078894 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:01.165978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-dc7964ce-a730-49a4-9458-1d21a9b95411 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:01.169581 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-dc7964ce-a730-49a4-9458-1d21a9b95411 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 1097 time: 0.0823431 May 25 15:51:01.175379 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.191540 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.201642 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b30aa332-9fe7-4ae6-8bf4-48a4395252d1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "DELETE /v2.0/floatingips/e0e23f1b-e60a-4257-881a-d0c6cf4e4300 HTTP/1.1" status: 204 len: 168 time: 1.0777452 May 25 15:51:01.438974 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-70080854-9a89-4e2d-848c-6454d79f6faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:01.440337 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-70080854-9a89-4e2d-848c-6454d79f6faf service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.2639525 May 25 15:51:01.516188 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-1fe63cc5-f19b-4f11-a26b-0a2b1e49b8de service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8 HTTP/1.1" status: 200 len: 217 time: 0.0668926 May 25 15:51:01.531277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.594749 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb6e07c-371d-4a09-8a3a-1bb71b0166e2 req-1873fb6a-6eec-43cd-aa1d-a761fc5ffacf tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:01.596336 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bbb6e07c-371d-4a09-8a3a-1bb71b0166e2 req-1873fb6a-6eec-43cd-aa1d-a761fc5ffacf tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 944 time: 0.2899334 May 25 15:51:01.602920 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-6e90bbd3-54ff-4e23-a93b-ff9b72c6b1bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:01.604420 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-6e90bbd3-54ff-4e23-a93b-ff9b72c6b1bb service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.0797901 May 25 15:51:01.705005 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-189a1838-6d82-499a-856c-bac8e536d9fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.714720 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bbb6e07c-371d-4a09-8a3a-1bb71b0166e2 req-14224534-24fb-4212-a6d0-4bc629e614c3 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1082153 May 25 15:51:01.735786 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-f2564fd8-fe51-4ae8-b121-45867c6b0eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:01.737388 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-f2564fd8-fe51-4ae8-b121-45867c6b0eb9 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1150806 May 25 15:51:01.785356 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35790) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:01.792231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group': {'name': 'tempest-securitygroup--319863012', 'description': 'tempest-description--500939195'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:01.800073 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:01.804979 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:01.808653 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:01.820291 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:01.832208 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:01.855124 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:01.859197 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:01.862354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:01.870753 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:01.952830 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-93159fd3-13cc-4f66-9578-9996a0f4434f service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1936226 May 25 15:51:02.034797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.041511 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.050339 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ae38a237-9f9f-4c8a-9754-aec43330a102 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:02.101515 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroup': ['ID=287cebae-437b-4eb0-858e-f16038051e6d,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:02.105476 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:02.107070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.111045 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.3219476 May 25 15:51:02.111405 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35796) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:02.116014 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-05d3cc15-9211-4441-beda-8b7cb40f5c34 req-3383abff-2f87-44b0-b6b8-e11a069e43f8 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1551640 May 25 15:51:02.117801 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group_rule': {'security_group_id': '287cebae-437b-4eb0-858e-f16038051e6d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:02.124721 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:02.128910 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:02.132215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:02.142553 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:02.161414 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.266954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.270416 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.272531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:02.297747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8e9c5de-1b5d-456c-baec-1fb07449b4c0,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:02.303686 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:02.309826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.311105 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1985166 May 25 15:51:02.313896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35802) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:02.319330 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'security_group_rule': {'security_group_id': '287cebae-437b-4eb0-858e-f16038051e6d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:02.326373 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:02.332183 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:security_group_rule and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:02.335697 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:02.343745 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:02.364600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.435970 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.441463 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.444672 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:02.471949 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1406ff2d-3b2a-4bab-b5f0-af737f6bfa26,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:02.474813 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:02.488434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.490052 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-230d5344-266a-4402-b21b-3badf2a43d6e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1751134 May 25 15:51:02.495322 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 35808) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:02.501385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:02.507883 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:02.512533 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:floatingip and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:02.522586 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:02.523135 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:02.535909 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.681840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.717320 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.851810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Allocated IP 172.27.1.148 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/2febd123-59d6-4cd8-8a54-6f7891e10abd) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:51:02.952459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8573fd-3eb2-46bb-a30a-afa70c01571e req-51c1bf51-4598-4e8c-be9b-f717fbe0a911 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:02.954381 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a8573fd-3eb2-46bb-a30a-afa70c01571e req-51c1bf51-4598-4e8c-be9b-f717fbe0a911 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 944 time: 0.1007919 May 25 15:51:03.013569 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a8573fd-3eb2-46bb-a30a-afa70c01571e req-ac0dcfd7-cc04-42b8-a899-2ac7fa0bc532 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485868 May 25 15:51:03.034677 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.066559 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.071798 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:03.137567 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:51:03.140687 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:51:03.144625 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:51:03.185460 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=2febd123-59d6-4cd8-8a54-6f7891e10abd,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:03.203220 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.203614 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.203982 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.204335 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.204686 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.205040 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.205390 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.205740 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.206094 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.206434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.206780 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.207119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:03.214070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:03.261494 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.346663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.595025 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.602488 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.609976 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-43a92944-027b-488e-b694-45d6c1860453 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:03.722527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=2febd123-59d6-4cd8-8a54-6f7891e10abd,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:03.726510 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:03.734119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.749011 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 3c24e981-4263-4e26-8e3f-289dd52b4ad8 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:51:03.757662 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.767122 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2627194 May 25 15:51:03.887964 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:03.903452 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'port_id': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'mac_address': 'fa:16:3e:e2:3f:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 800, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:51:03.969352 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.988292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3c24e981-4263-4e26-8e3f-289dd52b4ad8 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:51:04.018484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:04.022225 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-a6241929-9dad-4bee-b978-e2c034428ed1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--319863012&fields=id&tenant_id=0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 267 time: 0.0660563 May 25 15:51:04.026622 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:04.029438 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-ed8389dd-232a-4506-8691-c56b168103cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:04.112866 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:04.124472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:04.278317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-59dce87e-8cae-4c56-aea6-975550419315 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:04.280092 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-59dce87e-8cae-4c56-aea6-975550419315 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 810 time: 0.2383661 May 25 15:51:04.302800 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-78880da2-cee1-4820-be3d-e363e4b6c923 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/quotas/0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 375 time: 0.0163302 May 25 15:51:04.315630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e708077-2560-406c-a98c-235b8b91f632 req-150a0fe2-6b23-495b-9d94-8d1d5670ce93 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:04.317395 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e708077-2560-406c-a98c-235b8b91f632 req-150a0fe2-6b23-495b-9d94-8d1d5670ce93 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 945 time: 0.1655169 May 25 15:51:04.427082 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e708077-2560-406c-a98c-235b8b91f632 req-748dbd2a-ee76-4ccd-8da2-38151a1dea9e tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695362 May 25 15:51:04.435619 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:04.459334 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-5a032190-14c6-43fa-9bc0-b1acfac00a7b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1407895 May 25 15:51:04.600487 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['3c24e981-4263-4e26-8e3f-289dd52b4ad8'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:51:04.605126 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-bacc8c90-0313-40b7-98fa-c0f38f8dae84 service neutron] 10.222.0.25 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1349356 May 25 15:51:04.772230 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-1fa1d04a-f8b9-48d6-994c-f5e7a1ed2b8f service neutron] 10.222.0.25 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1608877 May 25 15:51:04.978082 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7b653c7b-8d6c-47c6-86c7-47f7c6b87777 req-027a2eff-1808-4283-acff-4d23ea055725 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 210 time: 0.0562203 May 25 15:51:05.676771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b1cb5e-0d12-4c37-aae6-856c440dd923 req-01f96135-b6c2-49ae-a646-1585bea96c2b tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:05.679675 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7b1cb5e-0d12-4c37-aae6-856c440dd923 req-01f96135-b6c2-49ae-a646-1585bea96c2b tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 945 time: 0.1216562 May 25 15:51:05.740425 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c7b1cb5e-0d12-4c37-aae6-856c440dd923 req-152dd481-104c-44b6-923f-1d807c88301d tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0538070 May 25 15:51:05.750465 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:05.773227 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 3c24e981-4263-4e26-8e3f-289dd52b4ad8 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:51:05.850239 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:51:05.856623 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:51:05.857016 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:05.986291 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:06.019111 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:06.030477 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:06.035203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:06.037507 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:06.119369 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:06.122830 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:06.162099 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'code': 200} May 25 15:51:06.358058 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e7749906-2e7d-438c-9a81-8cad16383eb3 req-e893d251-0a9d-47ab-990b-360f59214cf8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 210 time: 0.0583150 May 25 15:51:06.456993 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-42fe8052-922e-460e-879b-1710d49c2e7a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:06.459639 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-42fe8052-922e-460e-879b-1710d49c2e7a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 810 time: 0.3582673 May 25 15:51:06.534471 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-77ccda18-a607-45e1-abf4-f10450115a58 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0b066f0c91e94675a5051ab935c145f5 HTTP/1.1" status: 200 len: 379 time: 0.0467603 May 25 15:51:06.544464 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'port': {'device_id': '4582aa36-f251-4d3b-9575-5d2a57866605', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'admin_state_up': True, 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'security_groups': ['287cebae-437b-4eb0-858e-f16038051e6d']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:06.658643 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47267bba-9588-4be1-9646-ffb55added4e req-f459e54e-aaf7-4cb5-8ac5-8731f1c7eaac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:06.660159 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-47267bba-9588-4be1-9646-ffb55added4e req-f459e54e-aaf7-4cb5-8ac5-8731f1c7eaac service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 1099 time: 0.1723125 May 25 15:51:06.692366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:06.696565 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Usage tracker for resource:port and tenant:0b066f0c91e94675a5051ab935c145f5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:06.699984 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:06.705617 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:06.709942 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-47267bba-9588-4be1-9646-ffb55added4e req-049444ea-edb2-41eb-8874-6cc8326639f6 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0357618 May 25 15:51:06.715811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Made reservation on behalf of 0b066f0c91e94675a5051ab935c145f5 for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:51:06.719283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:06.958587 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Allocated IP 172.20.0.14 (132a5a94-c14e-4969-994e-837fe8b01394/cc89f65d-3227-4230-ac5b-a3041bcec0e2/c3f2d540-8269-4dae-aba9-dd94153728c1) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:51:07.020163 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bffd10-0e43-43e5-92a1-0bdffca1b453 req-4c95304a-d024-41a8-943f-2780a4c8a81a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:07.021669 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7bffd10-0e43-43e5-92a1-0bdffca1b453 req-4c95304a-d024-41a8-943f-2780a4c8a81a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.1491923 May 25 15:51:07.161322 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7bffd10-0e43-43e5-92a1-0bdffca1b453 req-8471fca1-a337-4ae9-8b6d-a58fd4175536 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1227844 May 25 15:51:07.205624 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:07.221517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Transition to ACTIVE for port object c3f2d540-8269-4dae-aba9-dd94153728c1 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:51:07.246971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:07.253268 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:07.325170 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Network 132a5a94-c14e-4969-994e-837fe8b01394 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:51:07.328353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:51:07.332057 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:51:07.367879 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event updated for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:07.386602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.386971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.387333 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.387715 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.388074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.388423 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.388774 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.389119 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.389466 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.389815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.390156 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.390500 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:07.396440 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:07.417535 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:07.418920 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:07.447266 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9067776 May 25 15:51:07.468557 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Request body: {'port': {'device_id': '4582aa36-f251-4d3b-9575-5d2a57866605', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:07.543012 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-87cada99-91e3-475d-b229-bcb83c2c1471 None None] Provisioning for port c3f2d540-8269-4dae-aba9-dd94153728c1 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:51:07.550771 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-87cada99-91e3-475d-b229-bcb83c2c1471 None None] Provisioning complete for port c3f2d540-8269-4dae-aba9-dd94153728c1 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:51:07.551407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-87cada99-91e3-475d-b229-bcb83c2c1471 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:07.617825 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-87cada99-91e3-475d-b229-bcb83c2c1471 None None] Port c3f2d540-8269-4dae-aba9-dd94153728c1 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:51:07.651630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:07.673600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c33bde-ec39-4290-82f4-01639a205838 req-7a3c4143-256a-4fe2-a7f2-ccdf116216a9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:07.674314 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-14c33bde-ec39-4290-82f4-01639a205838 req-7a3c4143-256a-4fe2-a7f2-ccdf116216a9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:51:07.755811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-14c33bde-ec39-4290-82f4-01639a205838 req-7a3c4143-256a-4fe2-a7f2-ccdf116216a9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:51:07.756946 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-14c33bde-ec39-4290-82f4-01639a205838 req-7a3c4143-256a-4fe2-a7f2-ccdf116216a9 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 932 time: 0.2524545 May 25 15:51:07.881838 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-14c33bde-ec39-4290-82f4-01639a205838 req-52c473d7-3e1e-4a29-a882-3f0ff2b9354f tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0821254 May 25 15:51:08.079653 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c3f2d540-8269-4dae-aba9-dd94153728c1 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:51:08.089491 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:08.107445 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Transition to ACTIVE for port object c3f2d540-8269-4dae-aba9-dd94153728c1 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:51:08.116459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:08.121691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-539d1ddf-7111-434a-8d6d-e5306f85e701 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:08.260610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Pushing event updated for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:08.400000 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:08.535178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Attempting to bind port c3f2d540-8269-4dae-aba9-dd94153728c1 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:51:08.535509 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Attempting to bind port c3f2d540-8269-4dae-aba9-dd94153728c1 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:51:08.535865 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Attempting to bind port c3f2d540-8269-4dae-aba9-dd94153728c1 on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:51:08.545458 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Port c3f2d540-8269-4dae-aba9-dd94153728c1 on network 132a5a94-c14e-4969-994e-837fe8b01394 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:51:08.545783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Attempting to bind port c3f2d540-8269-4dae-aba9-dd94153728c1 on network 132a5a94-c14e-4969-994e-837fe8b01394 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:51:08.553951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 51, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:51:08.554291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Checking segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:51:08.554679 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Bound using segment: {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:51:08.555110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Bound port: c3f2d540-8269-4dae-aba9-dd94153728c1, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d94defc-ad75-4154-8cd1-61c6b951613a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 834, 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:51:08.555461 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:08.626483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb25e35-9e3c-47ea-b598-331b0cdd4a8f req-1250e9c2-6cef-4afa-8ba7-d6ef6c3d3666 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:08.627983 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb25e35-9e3c-47ea-b598-331b0cdd4a8f req-1250e9c2-6cef-4afa-8ba7-d6ef6c3d3666 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.1658566 May 25 15:51:08.696330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:51:08.701032 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dfb25e35-9e3c-47ea-b598-331b0cdd4a8f req-1fc77e00-92cb-44ba-962e-c0a12b4a4961 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655777 May 25 15:51:08.706758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=c3f2d540-8269-4dae-aba9-dd94153728c1,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:51:08.710797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:08.716298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a32c8cec-63cb-4be7-b9f5-c45642999715 tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:08.773680 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:08.774301 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:08.775773 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] 10.222.0.74 "PUT /v2.0/ports/c3f2d540-8269-4dae-aba9-dd94153728c1 HTTP/1.1" status: 200 len: 1094 time: 1.3119459 May 25 15:51:08.776283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:08.799498 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Pushing event updated for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:08.803137 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:08.868612 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'status': 'completed', 'code': 200} May 25 15:51:08.980712 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856a29e9-0e00-43d9-9297-bfa1c40936a4 req-13e60177-6de0-4e30-ac91-81f50a19f212 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:08.982181 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-856a29e9-0e00-43d9-9297-bfa1c40936a4 req-13e60177-6de0-4e30-ac91-81f50a19f212 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.1493931 May 25 15:51:08.985379 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-4a1fa97a-8dd0-4c62-8fbf-ee30bb034e5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:08.987190 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-4a1fa97a-8dd0-4c62-8fbf-ee30bb034e5f service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 1097 time: 0.1163859 May 25 15:51:08.991927 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 35906) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:08.997579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Request body: {'floatingip': {'port_id': '3c24e981-4263-4e26-8e3f-289dd52b4ad8'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:09.177752 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-3331a1e5-39cb-4e4e-9fad-248bf033f5c8 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c3f2d540-8269-4dae-aba9-dd94153728c1 HTTP/1.1" status: 200 len: 217 time: 0.1198924 May 25 15:51:09.180153 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:09.377673 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-883f6826-c7c2-44e5-be7e-7424723c9ae0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:09.379099 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-883f6826-c7c2-44e5-be7e-7424723c9ae0 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.1424627 May 25 15:51:09.558385 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f224e0d1-919d-4edf-8acc-c3f8a0af323a req-fecf7c4c-48a0-4477-abb5-3807e9ce2b0a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:09.559960 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f224e0d1-919d-4edf-8acc-c3f8a0af323a req-fecf7c4c-48a0-4477-abb5-3807e9ce2b0a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 944 time: 0.5039439 May 25 15:51:09.702574 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f224e0d1-919d-4edf-8acc-c3f8a0af323a req-786d4fdb-c955-4c2f-8837-6eaa9800de19 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1333644 May 25 15:51:09.709373 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-59da4768-cded-4396-9666-8dcf7361d620 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:09.710814 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-59da4768-cded-4396-9666-8dcf7361d620 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2960186 May 25 15:51:10.175022 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-0fc1cc37-67b0-4145-aa14-399af2269a76 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4531443 May 25 15:51:10.457882 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b65e8f70-eaa6-4249-9be9-1bca5a08657c req-154e3f0b-7556-46b9-8b67-eb6584e82001 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2743936 May 25 15:51:10.470418 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:10.486738 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:10.716126 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Floating IP 11217005-5b1f-4223-ad0b-abf36b6b6b46 associated. External IP: 172.27.1.235, port: 3c24e981-4263-4e26-8e3f-289dd52b4ad8. May 25 15:51:10.810951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-0998a5e4-6c3c-4896-b079-2e5d495b34f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:10.812508 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-0998a5e4-6c3c-4896-b079-2e5d495b34f6 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 1097 time: 0.1865375 May 25 15:51:11.273475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-35fe9e34-aca7-4054-af03-e12ffa127822 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:11.274904 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-35fe9e34-aca7-4054-af03-e12ffa127822 service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.4099951 May 25 15:51:11.413967 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4aa7968-3b17-4c93-a349-e968fbc4f2df req-e3f60a78-1a46-4043-88e5-5f61d6798f71 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:11.415444 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e4aa7968-3b17-4c93-a349-e968fbc4f2df req-e3f60a78-1a46-4043-88e5-5f61d6798f71 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 944 time: 0.6004539 May 25 15:51:11.432593 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-79b6e11b-c383-402c-8bc4-36b4d8b9c3ea service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c3f2d540-8269-4dae-aba9-dd94153728c1 HTTP/1.1" status: 200 len: 217 time: 0.1482995 May 25 15:51:11.536105 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e4aa7968-3b17-4c93-a349-e968fbc4f2df req-47aac58f-1442-4b56-a5b4-6c13f6999f43 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1057270 May 25 15:51:11.547342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:51:11.559847 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-875a235f-6076-4d9d-a77a-300687b27127 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:11.559847 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-875a235f-6076-4d9d-a77a-300687b27127 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.1001840 May 25 15:51:11.795489 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-659d4220-94d1-4f97-86d4-521183fe3412 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:11.796923 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-659d4220-94d1-4f97-86d4-521183fe3412 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2381968 May 25 15:51:11.801750 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:51:11.806210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:11.823959 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:51:11.828286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device c3f2d540-8269-4dae-aba9-dd94153728c1 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:51:11.836038 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:51:11.836895 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:51:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:11.953444 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-dbf87415-76c2-4feb-8cf3-cabda2af1bb4 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "PUT /v2.0/floatingips/11217005-5b1f-4223-ad0b-abf36b6b6b46 HTTP/1.1" status: 200 len: 992 time: 2.9604537 May 25 15:51:11.956324 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:12.005550 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-ee12617f-7d04-4f47-bc19-3e7b15edb579 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1675243 May 25 15:51:12.090845 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:51:12.093804 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=c3f2d540-8269-4dae-aba9-dd94153728c1,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:12.109786 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'port_id': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'mac_address': 'fa:16:3e:c5:b6:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 834, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:51:12.135515 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'status': 'completed', 'code': 200} May 25 15:51:12.182716 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d497e-c066-46e3-99fe-6a297ff411fb req-c5c4d35d-ed15-4838-9890-5ee40a034d8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:12.184194 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-c5c4d35d-ed15-4838-9890-5ee40a034d8c service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=dd09b4c567df401194ac3825fe2e3080&device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 1099 time: 0.0855258 May 25 15:51:12.206046 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.214192 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa56394e-4daa-404e-b2bf-90768ebe372c req-943c8cb4-9cc3-4798-a80d-ddd69fdd07ec service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2016740 May 25 15:51:12.233357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c3f2d540-8269-4dae-aba9-dd94153728c1 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:51:12.254669 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=c3f2d540-8269-4dae-aba9-dd94153728c1,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:12.261618 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.263813 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:12.350218 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:12.356543 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:12.373548 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d497e-c066-46e3-99fe-6a297ff411fb req-3fa6d75d-93f2-46b0-8591-a78deffcb7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:12.375402 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-3fa6d75d-93f2-46b0-8591-a78deffcb7b3 service neutron] 10.222.0.74 "GET /v2.0/networks?id=f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 200 len: 918 time: 0.1842637 May 25 15:51:12.506475 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-077b87df-3f82-4d1f-8e81-8deea0714793 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8 HTTP/1.1" status: 200 len: 1000 time: 0.1236856 May 25 15:51:12.542722 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '11217005-5b1f-4223-ad0b-abf36b6b6b46', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.235', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 380, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:e2:3f:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:54Z', 'updated_at': '2021-05-25T15:51:10Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:12.550551 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:51:12.560365 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:51:12.560978 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:51:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:12.596584 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d497e-c066-46e3-99fe-6a297ff411fb req-93cf794e-362d-4acf-bfdd-e1fbe79a35e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:12.598453 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-93cf794e-362d-4acf-bfdd-e1fbe79a35e5 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 200 len: 856 time: 0.0848436 May 25 15:51:12.717753 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d497e-c066-46e3-99fe-6a297ff411fb req-79c5b6dc-83b0-4426-bc01-91b1fe92c6b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:12.719379 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-79c5b6dc-83b0-4426-bc01-91b1fe92c6b6 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=f2d88153-7a7c-4433-8f94-c27a6e5feb07&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1115513 May 25 15:51:12.747816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['c3f2d540-8269-4dae-aba9-dd94153728c1'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:51:12.774840 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bba2c77-498b-460c-a30b-a910c8f2b1e6 req-d2e0c4b6-7821-4217-b16a-fbf6417a4493 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:12.787804 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8bba2c77-498b-460c-a30b-a910c8f2b1e6 req-d2e0c4b6-7821-4217-b16a-fbf6417a4493 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 945 time: 0.1208382 May 25 15:51:12.807330 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:51:12.889039 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8bba2c77-498b-460c-a30b-a910c8f2b1e6 req-522eabdd-f51f-4134-880b-b8eeb44e447e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0995164 May 25 15:51:13.023702 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-0883d172-4a56-4fbf-9711-b6d4b11ca8f1 service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2967765 May 25 15:51:13.176344 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-185d497e-c066-46e3-99fe-6a297ff411fb req-af429e20-a53e-407e-87db-7c5683cba27c service neutron] 10.222.0.74 "GET /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1417859 May 25 15:51:13.311834 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '11217005-5b1f-4223-ad0b-abf36b6b6b46', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.235', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 380, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:e2:3f:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:54Z', 'updated_at': '2021-05-25T15:51:10Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:13.316152 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1030664-cf22-4718-bd17-fef7b2a1211a None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '11217005-5b1f-4223-ad0b-abf36b6b6b46', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'floating_ip_address': '172.27.1.235', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'port_id': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 380, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'mac_address': 'fa:16:3e:e2:3f:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:54Z', 'updated_at': '2021-05-25T15:51:10Z', 'revision_number': 1, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:51:13.517407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e49b7628-076c-4ae0-afe8-a6d00a833d7e None None] New status for floating IP 11217005-5b1f-4223-ad0b-abf36b6b6b46: ACTIVE {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:51:14.118495 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a019695-b66f-4d02-97e7-67a08d1c464f req-919c4cc0-5094-4c5d-9b3b-ee437c8b12f5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:14.120355 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a019695-b66f-4d02-97e7-67a08d1c464f req-919c4cc0-5094-4c5d-9b3b-ee437c8b12f5 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 945 time: 0.0918047 May 25 15:51:14.175776 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a019695-b66f-4d02-97e7-67a08d1c464f req-139125a6-139f-4f0c-bf2c-249c6a8a519d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448442 May 25 15:51:15.376353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97815e1-d24d-4f95-acbf-fb851cbd9b67 req-525345e5-fa2f-4653-8dc7-f1c9dfc9cb3d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:15.377810 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e97815e1-d24d-4f95-acbf-fb851cbd9b67 req-525345e5-fa2f-4653-8dc7-f1c9dfc9cb3d tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 945 time: 0.0841701 May 25 15:51:15.438266 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e97815e1-d24d-4f95-acbf-fb851cbd9b67 req-74fbb663-f566-4fbc-8a38-c512f0c631cd tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0533755 May 25 15:51:15.832758 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device c3f2d540-8269-4dae-aba9-dd94153728c1 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:51:15.904409 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port c3f2d540-8269-4dae-aba9-dd94153728c1 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:51:15.910497 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port c3f2d540-8269-4dae-aba9-dd94153728c1 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:51:15.910884 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.044692 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.071770 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:16.082163 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=c3f2d540-8269-4dae-aba9-dd94153728c1,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:51:16.086849 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.090281 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:16.141636 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'code': 200} May 25 15:51:16.164906 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:16.169154 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:16.431973 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da07bcba-8855-4b69-8be2-a4c30b43ced6 req-9065b0c0-40c5-41c6-9a1e-edb0bad05070 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:16.433855 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-da07bcba-8855-4b69-8be2-a4c30b43ced6 req-9065b0c0-40c5-41c6-9a1e-edb0bad05070 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 1099 time: 0.0867221 May 25 15:51:16.496375 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-da07bcba-8855-4b69-8be2-a4c30b43ced6 req-d627ea10-7d90-44d1-88ab-dd46b7c86dd8 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514550 May 25 15:51:16.652269 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0ac5c9-0e5c-40e9-8d99-7787dfe1f5e2 req-1b988d0d-f75f-493e-a884-6c540c9e1af1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:16.653742 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af0ac5c9-0e5c-40e9-8d99-7787dfe1f5e2 req-1b988d0d-f75f-493e-a884-6c540c9e1af1 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.0894613 May 25 15:51:16.706675 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af0ac5c9-0e5c-40e9-8d99-7787dfe1f5e2 req-8b962b03-381c-4578-8ae5-231e5b9e89db tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472336 May 25 15:51:17.916946 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c53518-3089-45ff-8af0-2648105b797c req-d8695966-508d-49cc-bfae-a85fc114ed6c tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:17.918345 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-29c53518-3089-45ff-8af0-2648105b797c req-d8695966-508d-49cc-bfae-a85fc114ed6c tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.0867591 May 25 15:51:17.965282 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-29c53518-3089-45ff-8af0-2648105b797c req-7ada3314-112e-497f-8c40-0abc61834ebc tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413344 May 25 15:51:19.193321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74428b0d-e4ac-4de4-8be2-a25ee8664999 req-15a093b5-3283-4871-b580-068c9fa7ba28 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:19.195504 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-74428b0d-e4ac-4de4-8be2-a25ee8664999 req-15a093b5-3283-4871-b580-068c9fa7ba28 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.1104286 May 25 15:51:19.242362 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-74428b0d-e4ac-4de4-8be2-a25ee8664999 req-ebbf7ca0-0210-48cf-82d8-2402b1e3363b tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408561 May 25 15:51:19.549092 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a4030c-a060-4cb0-9bd9-d04efdf54359 req-66d03214-154b-4a1a-918b-23af505bd7ce tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:19.550551 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-04a4030c-a060-4cb0-9bd9-d04efdf54359 req-66d03214-154b-4a1a-918b-23af505bd7ce tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.1945817 May 25 15:51:19.559430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 36020) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:19.564647 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Request body: {'floatingip': {'port_id': 'c3f2d540-8269-4dae-aba9-dd94153728c1'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:51:19.648173 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:20.282371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:20.288063 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:20.429923 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:51:20.464935 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Floating IP a2f6a0bf-1789-4474-94a4-160bc348351f associated. External IP: 172.27.1.148, port: c3f2d540-8269-4dae-aba9-dd94153728c1. May 25 15:51:20.873593 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:51:21.232086 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:51:21.236660 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:21.242712 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:51:21.252507 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:51:21.253108 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:51:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:21.297812 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-1726d54c-7984-404b-8270-5f6609e3f4c8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "PUT /v2.0/floatingips/a2f6a0bf-1789-4474-94a4-160bc348351f HTTP/1.1" status: 200 len: 992 time: 1.7371943 May 25 15:51:21.298547 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:51:21.352458 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'status': 'completed', 'code': 200} May 25 15:51:21.477745 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:51:21.518869 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-695e5638-1662-4ec4-a39a-bc8068fc5e2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:21.521433 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-695e5638-1662-4ec4-a39a-bc8068fc5e2d service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=0b066f0c91e94675a5051ab935c145f5&device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 1099 time: 0.0787416 May 25 15:51:21.668703 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-967c1b78-20a1-4d8f-94ab-1c0c2fb37773 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:21.670234 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-967c1b78-20a1-4d8f-94ab-1c0c2fb37773 service neutron] 10.222.0.74 "GET /v2.0/networks?id=132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 200 len: 911 time: 0.1381321 May 25 15:51:21.801820 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-6e9948b0-45ce-4e12-be74-e0c7c91fa113 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=c3f2d540-8269-4dae-aba9-dd94153728c1 HTTP/1.1" status: 200 len: 1000 time: 0.1180513 May 25 15:51:21.845651 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'a2f6a0bf-1789-4474-94a4-160bc348351f', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.148', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:c5:b6:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4582aa36-f251-4d3b-9575-5d2a57866605', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:51:03Z', 'updated_at': '2021-05-25T15:51:20Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:21.849963 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:51:21.859309 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:51:21.859966 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:51:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:21.880896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-d3843442-cad6-4acc-a691-704fab66131c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:21.882341 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-d3843442-cad6-4acc-a691-704fab66131c service neutron] 10.222.0.74 "GET /v2.0/subnets?id=cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 200 len: 849 time: 0.0689807 May 25 15:51:21.981191 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-453bc5ae-0727-46dd-9f45-f3e2ec73d390 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:21.982772 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-453bc5ae-0727-46dd-9f45-f3e2ec73d390 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=132a5a94-c14e-4969-994e-837fe8b01394&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0914013 May 25 15:51:22.104298 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:51:22.133511 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-6667f81a-b16c-46b1-85bd-26c198fa01a3 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1417942 May 25 15:51:22.359171 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-17ce53d1-4b02-4bda-b47d-fc965456eff9 req-0297284a-9b42-4172-b0f7-f40802b443d3 service neutron] 10.222.0.74 "GET /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2159162 May 25 15:51:22.494103 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'a2f6a0bf-1789-4474-94a4-160bc348351f', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.148', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:c5:b6:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4582aa36-f251-4d3b-9575-5d2a57866605', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:51:03Z', 'updated_at': '2021-05-25T15:51:20Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:51:22.499031 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4369dd6-0738-4d8a-b8ef-9fc1025e2b7f None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'a2f6a0bf-1789-4474-94a4-160bc348351f', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'floating_ip_address': '172.27.1.148', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'port_id': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'mac_address': 'fa:16:3e:c5:b6:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4582aa36-f251-4d3b-9575-5d2a57866605', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:51:03Z', 'updated_at': '2021-05-25T15:51:20Z', 'revision_number': 1, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:51:22.689816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c5bb089-de29-4146-ab7d-5b1fb12feb3c None None] New status for floating IP a2f6a0bf-1789-4474-94a4-160bc348351f: ACTIVE {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:51:29.150795 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-774eeba5-fa78-4237-b4f0-fde709b714df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:31.530250 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:31.689093 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bf1ede7f-c9e4-4d18-be10-0178faccfe54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:32.721155 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:34.435313 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:35.749047 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.860892 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-00cdbe78-1239-4c95-86b0-6cdd4f55d496 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0693629 May 25 15:51:43.988182 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-770117ee-fae0-42aa-88c9-7ee7e26b1e61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:43.988393 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-770117ee-fae0-42aa-88c9-7ee7e26b1e61 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.0848858 May 25 15:51:44.171879 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-709a45ed-0898-4bcd-90a4-4c00f88c31db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:44.173507 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-709a45ed-0898-4bcd-90a4-4c00f88c31db service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1473088 May 25 15:51:44.248769 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-55bc50b3-b027-438f-8788-3ba38703737c service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.0677986 May 25 15:51:44.321932 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-01a37fb3-2ae8-4592-aaac-3cee5b6f69a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:44.324008 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-01a37fb3-2ae8-4592-aaac-3cee5b6f69a6 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0683091 May 25 15:51:44.376261 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-4c85d6cb-fcba-48bd-85eb-2b76fe44d967 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431297 May 25 15:51:44.388905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-7eb3d56b-0e5e-4b85-8195-2aa01938e34a service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98391) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:51:44.389920 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-7eb3d56b-0e5e-4b85-8195-2aa01938e34a service neutron] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0051172 May 25 15:51:44.537236 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-ae249113-bfc4-4c1b-8073-3685f9530657 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1348312 May 25 15:51:44.674851 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e2dd47c5-e307-40c4-9763-a71dbb59d596 req-5d2d4795-3314-48c4-b155-e0d8fc90fb64 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257699 May 25 15:51:57.430724 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:51:59.153974 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d760724d-fa88-432d-b738-7ed0cd2c47c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:01.526375 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:01.689815 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3a39c8ff-88d5-4f9f-8482-f6da1994be9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:02.725831 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:04.433680 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:05.758058 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:29.156143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-77ad4f45-c565-4a11-acb5-574625f9f778 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.531975 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.691203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c4934d84-6a03-45f6-9878-e4bbf892279d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.725846 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:34.429810 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:52:34.435357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.784105 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:43.958198 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-7579aaac-da06-4ca6-84e5-ba27b68d2d23 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1491907 May 25 15:52:44.072654 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-bd2ebc3c-fb1c-47b0-89ba-9398eb2d2336 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:44.074118 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-bd2ebc3c-fb1c-47b0-89ba-9398eb2d2336 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1099 time: 0.0787349 May 25 15:52:44.238145 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-096562b1-bdbe-4097-88d2-40b63321538f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:44.239533 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-096562b1-bdbe-4097-88d2-40b63321538f service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1322522 May 25 15:52:44.313392 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-7faf10ad-e3b0-4a55-ac7c-4639b9cf8d5d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 200 len: 217 time: 0.0665658 May 25 15:52:44.378146 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-f09b6567-8e12-4acc-b6c3-ad441e36d2b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:44.379589 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-f09b6567-8e12-4acc-b6c3-ad441e36d2b9 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0587454 May 25 15:52:44.426988 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-b661f958-80fc-4e74-b81a-1c9676216319 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0398490 May 25 15:52:44.557460 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-ca17a415-0897-4838-a6cc-43b94e8dbf4c service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1226082 May 25 15:52:44.691608 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-9a7984da-d358-471b-9d5a-e3ab1ff26d6e req-a6352997-a4c0-43ba-9de2-43cebadf43d7 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274309 May 25 15:52:59.161013 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7eb7b540-a4cd-40d7-92f0-bb03278cab61 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:01.526158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:01.684160 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bc7679c8-683a-41fc-87b1-fb738d38f944 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:02.728184 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:04.446389 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:05.812895 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:11.428153 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:53:29.169186 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3e110cb3-0ace-42e0-b799-ddb1f4bfdf80 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:31.538815 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:31.686472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5e5ccd96-2215-40d5-9909-bd0c291e80ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:32.730637 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:34.440602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:35.806994 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:44.943191 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-4353142e-fa1d-4ef6-84dc-12ab8e75d95b service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1585908 May 25 15:53:45.046885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-8b77c0ac-5461-4cc3-bb6d-932c1a5a23fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:53:45.048369 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-8b77c0ac-5461-4cc3-bb6d-932c1a5a23fb service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=ac7ba677968248629edb2c52ffcbaf6b&device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 1098 time: 0.0721924 May 25 15:53:45.201620 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-995a4285-3e65-4bfd-8b68-d4d22a3709fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:53:45.203286 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-995a4285-3e65-4bfd-8b68-d4d22a3709fa service neutron] 10.222.0.74 "GET /v2.0/networks?id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd HTTP/1.1" status: 200 len: 914 time: 0.1343524 May 25 15:53:45.277315 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-e7b511d7-6a5d-413a-bf0c-2db49ac03500 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=73cac064-2d02-401c-bb22-890fdda0d24a HTTP/1.1" status: 200 len: 217 time: 0.0655346 May 25 15:53:45.348150 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-1ec64d34-0497-4c86-9ac6-8375901d79b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:53:45.349577 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-1ec64d34-0497-4c86-9ac6-8375901d79b8 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=8359c6d8-0d8a-4f13-a065-36bfd3350e4a HTTP/1.1" status: 200 len: 853 time: 0.0581167 May 25 15:53:45.400369 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-e766bcb3-d0e4-423f-ae5f-8db37cee9ffb service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0439723 May 25 15:53:45.535492 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-7ae2b666-dca4-470d-852f-9cbc6f38683a service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280494 May 25 15:53:45.671331 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-4b73acad-0f91-4c56-833c-6723c39fdcda req-7b9aa4e9-f378-4408-b4b7-8db8a745d51e service neutron] 10.222.0.74 "GET /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290855 May 25 15:53:48.427022 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:53:59.163358 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-99b68bfc-1aed-4bb3-87c7-bae23414842c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:01.533219 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:01.688928 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7e480880-4128-4da5-81d2-6e9d00755448 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:02.732607 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:04.446042 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:05.824683 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:25.427039 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:54:29.166882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a31d9e3c-468f-4556-8eaf-6ca89ec30384 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:31.537452 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:31.691451 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b639fda6-151b-47a7-ab26-2e21efe1f70f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:32.735456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:34.447703 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:35.822964 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:45.093045 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-dc9fbc68-a897-4041-9a76-7b87c4076f5d service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0897086 May 25 15:54:45.198240 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-aff9ac62-826a-4d24-abe0-dcd6c092db2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:54:45.199725 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-aff9ac62-826a-4d24-abe0-dcd6c092db2b service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1098 time: 0.0740607 May 25 15:54:45.344846 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-0641890e-f877-4176-bff8-cec85a13df3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:54:45.346255 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-0641890e-f877-4176-bff8-cec85a13df3a service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1256304 May 25 15:54:45.429478 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-cdb5bb0f-0c5c-4c69-8fd8-d5f239644fcb service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 200 len: 217 time: 0.0759575 May 25 15:54:45.510233 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-6454b575-8352-4116-b462-405322a890af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:54:45.511677 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-6454b575-8352-4116-b462-405322a890af service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0734169 May 25 15:54:45.559259 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-d86ba09c-e6bc-49e6-9eb5-f00a37b780b1 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0407479 May 25 15:54:45.697838 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-ae9d4f14-0f8b-4056-be49-1c63f5ef5be1 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307058 May 25 15:54:45.832680 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-1f5220ea-4723-4b24-849f-43d37681ad48 req-ec8cfd15-dad0-4471-ab01-24d3d9dbbc90 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272624 May 25 15:54:59.170234 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1a7c67ae-c336-4a35-94ee-2332afcebc13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:01.580078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:01.698087 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fcf2521-ab14-47a8-898c-5dccecfcd20d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:02.426883 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:55:02.740793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:04.448945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:05.840893 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:29.172606 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8fdd1573-e458-4dc0-b962-1fd59e765d5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:31.544186 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:31.689113 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7e0965cc-03ae-43b0-b01d-5b30d0ef0dcd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:32.743915 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:34.450562 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:35.844170 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:39.426845 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:55:45.847112 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-19779766-82b7-4433-816d-7fddcdb22b57 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0715303 May 25 15:55:46.038076 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee568723-699d-47b6-893c-03d7192dc4fc req-47a15424-9805-474e-bfee-6f7a2eb7da56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:55:46.039576 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-47a15424-9805-474e-bfee-6f7a2eb7da56 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 1099 time: 0.1581209 May 25 15:55:46.186497 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee568723-699d-47b6-893c-03d7192dc4fc req-2f707e89-fb60-42d6-b4f1-fd4f672dc1e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:55:46.187869 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-2f707e89-fb60-42d6-b4f1-fd4f672dc1e4 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1278722 May 25 15:55:46.259765 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-c5812ba8-bd35-4c73-bfa5-e3025f433775 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fd471234-c522-4ab5-852b-64ca2a29444b HTTP/1.1" status: 200 len: 217 time: 0.0641980 May 25 15:55:46.324190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee568723-699d-47b6-893c-03d7192dc4fc req-76eec40b-5ab4-40a1-9b0a-8222fab1f9b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:55:46.325626 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-76eec40b-5ab4-40a1-9b0a-8222fab1f9b3 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0585430 May 25 15:55:46.374256 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-034a67bf-9d93-4514-a8fd-215a59e7ccc3 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0410445 May 25 15:55:46.508829 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-04cf4ab7-25f0-4670-8d2f-3e4becd5a850 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273756 May 25 15:55:46.658295 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-ee568723-699d-47b6-893c-03d7192dc4fc req-416676e7-533f-489a-a669-77da73c1ad9f service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415150 May 25 15:55:59.177970 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-24fc816b-2499-416f-b1cd-18eb40f0421a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:01.548700 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:01.691623 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2af2568f-0ff8-4101-97cb-8acad6fdfa28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:02.754272 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:04.462115 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:05.861489 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:06.583047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 39210) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:56:06.834796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Deleting subnet ecf40f71-ad00-492f-859e-f0dffb465329 {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:56:06.838282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:06.915036 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:06.972680 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.256811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.260733 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:56:07.297932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.301048 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ecf40f71-ad00-492f-859e-f0dffb465329,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:56:07.310407 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.310783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.311145 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.311508 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.311913 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.312246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.312626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.312976 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.313328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.313674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.314023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.314366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:07.317922 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/ecf40f71-ad00-492f-859e-f0dffb465329 HTTP/1.1" status: 204 len: 168 time: 0.7336791 May 25 15:56:07.318765 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:56:07.320231 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 39222) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:56:07.431862 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.596404 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.610167 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8243927b-fe77-4d86-8b11-a55922605928']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:56:07.624583 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '51c10ea2-0dbc-480a-a608-62cd2596fba8') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:56:07.625029 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '51c10ea2-0dbc-480a-a608-62cd2596fba8') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:56:07.638439 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.657064 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.663366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Releasing vlan 816 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:56:07.664076 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:56:07.679370 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:56:07.759237 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.766935 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ca973229-3a96-4e07-993e-835bee594184 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:56:07.784067 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.793097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Pushing event deleted for resources: {'Network': ['ID=8243927b-fe77-4d86-8b11-a55922605928,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:56:07.799123 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] 10.222.0.25 "DELETE /v2.0/networks/8243927b-fe77-4d86-8b11-a55922605928 HTTP/1.1" status: 204 len: 168 time: 0.4778688 May 25 15:56:07.800643 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-022f6e7f-44fc-4814-bb78-bcdf19e95f38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:56:07.939731 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 39236) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:56:07.996225 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1668dfa0-923c-466a-b65a-5ae562be7d87 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ef6e18c9984d41f9a3952db092f0e3c8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0551748 May 25 15:56:07.999764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 39240) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:56:08.059563 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:08.085761 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:08.149668 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:08.154947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1870f40c-56e9-4309-8e02-4a6e249dc770 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:56:08.169165 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76b89f39-d2ca-40dd-8ff1-330d3224d990,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:56:08.178008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:08.179153 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/76b89f39-d2ca-40dd-8ff1-330d3224d990 HTTP/1.1" status: 204 len: 168 time: 0.1779580 May 25 15:56:08.180913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.181287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.181649 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.182003 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.182353 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.183104 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.183282 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.183514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.183891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.184232 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.184572 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.184909 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:56:08.188453 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:56:16.431280 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:56:29.188495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-68acc9f5-6b4b-4960-809b-704966a064d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:31.560533 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:31.698409 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-72fd9b4f-f206-49c2-b548-0ab75a82b77e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:32.749236 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:34.466996 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:34.860467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd2abcd-3989-484c-92f9-c3fea1a66ee9 req-58fdae50-2be3-4d7a-a4d7-71906439378c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:56:34.861931 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbd2abcd-3989-484c-92f9-c3fea1a66ee9 req-58fdae50-2be3-4d7a-a4d7-71906439378c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.3059320 May 25 15:56:34.907517 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fbd2abcd-3989-484c-92f9-c3fea1a66ee9 req-bb7c98f3-8aba-4db1-8d9e-df30cf9c704f tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/security-groups?id=76fee170-46c4-4984-b18d-a602291af03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393918 May 25 15:56:35.365137 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-0842b2ad-5ef9-4307-8ef3-dc68e4a361d0 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:56:35.365836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-0842b2ad-5ef9-4307-8ef3-dc68e4a361d0 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Synchronizing usage tracker for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:port {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:56:35.383743 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-0842b2ad-5ef9-4307-8ef3-dc68e4a361d0 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Unset dirty status for tenant:ac7ba677968248629edb2c52ffcbaf6b on resource:port {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:56:35.384970 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-0842b2ad-5ef9-4307-8ef3-dc68e4a361d0 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.74 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 945 time: 0.1032372 May 25 15:56:35.524489 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Deleting port 73cac064-2d02-401c-bb22-890fdda0d24a {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:56:35.524836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:35.662044 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] For port 73cac064-2d02-401c-bb22-890fdda0d24a, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73cac064-2d02-401c-bb22-890fdda0d24a,segment=NetworkSegment(01e89f68-a28a-4109-a6b7-004659c4f358),segment_id=01e89f68-a28a-4109-a6b7-004659c4f358)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:56:35.662396 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:35.789855 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Calling delete_port for 73cac064-2d02-401c-bb22-890fdda0d24a owned by compute:nova {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:56:35.876559 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:35.928944 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:35.935667 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0d710639-8ad8-4808-94c8-96905896c42c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:56:35.986473 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Pushing event deleted for resources: {'Port': ['ID=73cac064-2d02-401c-bb22-890fdda0d24a,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:56:35.989671 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:56:36.064929 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] No DVR routers for this DVR port 73cac064-2d02-401c-bb22-890fdda0d24a on host hv-cinder-78638 {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:56:36.067663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:36.070359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'name': 'network-vif-deleted', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:56:36.088468 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-e1a2b852-bcdf-4365-a75d-aa91be8ac7d2 req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.74 "DELETE /v2.0/ports/73cac064-2d02-401c-bb22-890fdda0d24a HTTP/1.1" status: 204 len: 173 time: 0.6977456 May 25 15:56:36.195827 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0fc1b89-2077-48c7-b3b8-5e974ffff69c req-96ebd4dc-5f6c-4ce8-9141-8308b57b608c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.1346359 May 25 15:56:36.264162 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4', 'name': 'network-vif-deleted', 'tag': '73cac064-2d02-401c-bb22-890fdda0d24a', 'status': 'completed', 'code': 200} May 25 15:56:37.398314 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3304f66b-9686-44fa-a944-a38c8732c604 req-80a490a8-a65a-4435-af7b-ca39568bc852 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0646586 May 25 15:56:37.629417 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73cac064-2d02-401c-bb22-890fdda0d24a no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:56:37.667306 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 73cac064-2d02-401c-bb22-890fdda0d24a {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:56:37.667757 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73cac064-2d02-401c-bb22-890fdda0d24a not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:56:38.600804 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-51bf0254-1268-4314-bbd4-90b0ecc655be req-a6478542-e2bc-4be2-936c-35253ef092a9 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0581312 May 25 15:56:39.789408 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ee371a53-ad84-4ee9-a50d-e1d9d0d870f6 req-f1cac0c1-e29a-401e-b6af-e06c81cde09c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0470033 May 25 15:56:40.947925 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ecdd3317-ef47-45ca-a4f2-c2364d9e74d6 req-b385eff5-23d3-4381-95fc-76b5bedc84e9 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0456796 May 25 15:56:42.283852 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a2ff2cf6-ab25-470b-8eb6-3d90d3622e65 req-3fb4140d-2aa4-4681-a0aa-9ecac142e5b7 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.1759198 May 25 15:56:43.468801 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6bacedf1-f957-4949-9c5d-e3b6711d93d6 req-70dcaaae-47f3-427b-b8d8-fe419c8bc207 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0624096 May 25 15:56:44.669069 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-329895f5-3e2d-4bd6-8498-c1323fb7a287 req-b4055919-997f-4bd0-9fa6-040d13958f5c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0640976 May 25 15:56:45.834817 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-82de0559-53f3-48b6-9ccd-1f880c1f6af4 req-513656fd-fd9a-4ec6-8b57-4df943c90206 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0476956 May 25 15:56:46.968126 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-9de54457-663a-457d-af4c-135afcf7069d service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1644473 May 25 15:56:47.006344 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0c9437ef-df90-44f7-a8cf-0ddb76933d86 req-c65356fe-ab14-4fd9-8331-a59633b87b3c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0448370 May 25 15:56:47.141807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87d6624-8915-4117-89cb-954857d66805 req-c01a8fb2-4a1a-4c41-9091-6047a600bda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:56:47.143258 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-c01a8fb2-4a1a-4c41-9091-6047a600bda7 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0788903 May 25 15:56:47.322490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87d6624-8915-4117-89cb-954857d66805 req-a4b8304c-a3b9-445a-828a-116a460a1633 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:56:47.323966 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-a4b8304c-a3b9-445a-828a-116a460a1633 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1550148 May 25 15:56:47.437124 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-45d301e4-f33d-44a3-b043-8f66c292eecf service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.1046727 May 25 15:56:47.499804 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87d6624-8915-4117-89cb-954857d66805 req-2fc4b7c2-af27-418a-a0ca-bc454e5dde31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:56:47.501193 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-2fc4b7c2-af27-418a-a0ca-bc454e5dde31 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0577822 May 25 15:56:47.553466 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-5a7942e1-a4fe-4d57-ac31-f323bfa7e4ae service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0449309 May 25 15:56:47.690384 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-6d34d35d-0d2c-4aa5-8528-b72108f67440 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1285717 May 25 15:56:47.846936 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-b87d6624-8915-4117-89cb-954857d66805 req-84989085-2cc9-42d0-9f25-70378298c79a service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1461923 May 25 15:56:48.328968 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e4e644f-dad7-469a-93e7-919111b3f8a1 req-b6d3666a-3022-4154-bc70-233c6384690d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0569825 May 25 15:56:49.486170 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9afceff1-4e5a-4a0c-a250-6ecdfd409d1b req-bfdeda3f-a521-4105-a49d-9963810f23bc tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0441086 May 25 15:56:50.665303 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-55cb3859-9338-485d-94a5-a387cb97ad76 req-79a9c4c1-925e-447a-88cb-97581b1195b9 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0655420 May 25 15:56:51.889597 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8397190d-e3b3-4a1c-b981-6c32b9891ad3 req-ad46fb3c-8bc8-4aa1-a8b0-08d6a769875c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0465474 May 25 15:56:53.077500 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bde02b68-b37b-4b32-903c-6a341f095721 req-034dc047-8c22-463c-bbe5-b920f10e2321 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0463758 May 25 15:56:53.431035 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:56:54.240786 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-71f41918-e081-46f2-8a8a-9a2306cf7e23 req-5caf7c7d-51ac-4010-9759-325e83a9eaa8 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0437441 May 25 15:56:55.396286 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7241cbc3-d4d4-4d77-a4bb-a8206773b8b8 req-4c6d48ec-9f51-469c-81d8-b8ac37b46b8a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0473647 May 25 15:56:56.591916 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b2e00068-72ee-4593-b1bd-6838a8458ac5 req-0fc2b511-2ca6-4a6d-a9d5-f0bedb2197a3 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0454805 May 25 15:56:57.788760 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ec3b8d50-e274-4d71-80f1-ba5ce62e63a7 req-c7cef039-7589-4a23-b3be-8e5a70ca996b tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0774605 May 25 15:56:59.022957 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ea14a0fb-d019-4403-ad0e-bf2acdec698d req-2258f527-22bf-4a5e-8e06-00036ca0c017 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0482333 May 25 15:56:59.190941 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b8d28bac-ad52-439c-9108-13356c5c19bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:00.186393 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db1e8030-8b8b-4a1c-a2ca-8a61638fdd1d req-f32ba79e-eaed-4b71-9353-4af78dbed922 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0536656 May 25 15:57:01.399327 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b1e410ae-e993-4364-ba24-0b052cdd7b91 req-58633612-1f66-4404-86cb-90db6011eb75 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0498328 May 25 15:57:01.557796 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:01.697180 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4b351041-1044-4780-ba45-5906c515e055 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:02.074296 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-ee0f5554-d47e-458a-8820-7e9e5c079384 req-2f1fb9d3-0cde-48f7-a2d5-fbd4de600ffb service neutron] (98392) timed out ('10.222.0.74', 61742) {{(pid=98392) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 15:57:02.586530 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4eb9d92-f4d8-4c1c-8b4b-83702545a4fa req-30ea313f-bf92-4964-b12b-fa729d690459 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0545692 May 25 15:57:02.754359 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:03.759329 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7043b1e-89b7-45d9-9b4b-ea17d0934c05 req-935c610c-4c4b-41db-8e24-ae66e23a6655 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0430641 May 25 15:57:04.206186 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [req-d41e7942-cc5f-489a-bf6b-6a9b599a0602 req-36889254-a016-4869-aa3a-66584c07457b service neutron] (98391) timed out ('10.222.0.74', 61713) {{(pid=98391) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 15:57:04.471249 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:04.932561 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44b8726a-d663-467f-b4df-833a61c25aef req-0054e74f-789c-498d-9cb9-d3753b9d2d2b tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0472383 May 25 15:57:05.893161 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:06.096045 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c826778c-3e61-443c-97a6-6a31631c2b4c req-ef2b21de-1a99-4016-834a-af2b2e828abf tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0513418 May 25 15:57:07.277350 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6962d7bd-137d-4d19-acd9-50012345f23f req-682e03d7-cbdb-437b-8e4f-a50373cdf365 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0544786 May 25 15:57:08.365858 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [req-0afbba13-2a5f-4cce-9123-a7884c369872 req-fcbfed89-efbb-460c-bc97-0be2614d85bf service neutron] (98391) timed out ('10.222.0.74', 61738) {{(pid=98391) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 15:57:08.443784 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-caa2b459-ee29-423a-bc7b-83a1b170cdb0 req-17b82318-6276-497a-ac85-ef0908fa15fa tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0498867 May 25 15:57:09.620912 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c0555ca9-4772-4f35-adae-5ae658f34476 req-879d638b-8201-487e-a0b9-3525a03f2798 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0479891 May 25 15:57:10.771812 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-988411d3-00bf-4f38-b4d9-aab17a975e20 req-5cefaf77-d35a-4024-a6f2-1cdbe87bee35 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0432167 May 25 15:57:11.926918 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e8ddaa2b-e1e3-4c5f-a6e4-7128895d6ab8 req-e3be34a2-9493-4c21-97be-c14903e10dc1 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0437434 May 25 15:57:13.081666 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-118e2385-a8ec-48e7-a2dd-a4a1d8f06165 req-3255f6cb-fa92-4aa1-b1ca-e98c7c113f67 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0474505 May 25 15:57:14.231646 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca7ec4f7-c40f-43e6-b25c-55d2122a052b req-de79759f-7ae9-4785-bd96-2ef593dee65d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0437064 May 25 15:57:15.383254 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6f3774ef-1667-49ae-bf4f-e1da13d7943e req-3808a5ba-14da-420f-a6b1-6647e3c5ec51 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0428085 May 25 15:57:16.542536 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0656d3fb-6fc4-4840-9b67-609450ec66d2 req-17555c7d-515d-418c-b61a-f015333db38d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0468266 May 25 15:57:17.704143 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2d7766de-331a-49c8-ab57-10a963556c13 req-10716572-2673-48c5-9760-450b6e00ca57 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0556006 May 25 15:57:18.856898 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-84fca39e-daf8-4a34-b5df-f8a27efa659e req-37d7e88e-cd73-466e-8258-b169c42c38e5 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0441709 May 25 15:57:20.014069 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b49f011-f161-4cc2-b860-6f16cfb729d4 req-a8664de4-6526-4c2c-a0a0-632153c8af6c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0454352 May 25 15:57:21.250567 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b523f6e7-8437-41d9-b100-caf1e5730a35 req-8eda2799-9ba8-42d6-a05e-155b2fde99cf tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.1283350 May 25 15:57:22.401188 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cea517cb-cde9-4c93-88ca-5a64fb3a92f1 req-c8176b0b-f60f-41e1-9e40-b08888a23079 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0434103 May 25 15:57:23.548945 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d6dd0db1-b73f-4dbb-8c7f-f715e9b43204 req-62af2dbd-fbac-4184-b484-7e134e8b2329 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0444386 May 25 15:57:24.696041 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-da766d1f-c141-4aa5-a1f2-4c88d87d498c req-143eb7fa-6403-42f2-a99e-fdd20487e182 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0427923 May 25 15:57:25.844837 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cbfd3594-4b0d-42dc-b3a1-c78a8430eeef req-41f0afd5-f849-4cfa-8e14-1e013960c918 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0418878 May 25 15:57:26.996624 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3bf5b664-ca50-4bbb-907d-ccd21e7150ef req-2be55847-d212-41da-9594-ecc6021aafd2 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0442967 May 25 15:57:28.149512 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-57473b5f-aa97-4ed9-8d68-faea7738577c req-ee3b37fe-754e-4eec-a99a-6fae75ade500 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0449646 May 25 15:57:29.185798 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-35662410-8c26-4f08-a0ba-92dd0adc4c0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:29.306740 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4bda395c-289b-4798-beff-11c363a1e146 req-c3ca9694-9a35-4450-8298-728313fe7e8b tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0433135 May 25 15:57:30.432674 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:57:30.462196 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2642c2b7-83f0-47c3-a7f7-0e354286e345 req-76278f36-58f4-4faf-9f7f-8abaf3e6ab9a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0452754 May 25 15:57:31.564400 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:31.642447 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d84b9b9a-d932-4927-a16d-d9f370c42986 req-b81b1e1d-a397-4e73-99fb-5b6f2150ae1b tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0447004 May 25 15:57:31.691746 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-142b50bb-6ce1-4699-bef9-929468447414 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:32.763982 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:32.806172 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-91efde3d-beca-4433-a031-9c93cd05cba8 req-4f4e0a92-de13-48b1-987c-c5a018d291d7 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0437081 May 25 15:57:34.096424 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c1f0083d-95b3-41b3-ba17-871a319d0b87 req-b5bc5dc1-7756-44ff-9140-0f4cee4dd567 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0478399 May 25 15:57:34.468266 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:35.261213 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b08b0e5c-7ead-4568-8b25-4a7c62d612f7 req-ae1e6b05-615f-43ca-af2a-162d451e7a12 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0429285 May 25 15:57:35.898680 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:36.312873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead88aa8-bfe9-4d80-aa0d-f09eb8bb4a0d req-b60f19a5-e93a-4648-bfb1-151fea84c4dc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:36.314428 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ead88aa8-bfe9-4d80-aa0d-f09eb8bb4a0d req-b60f19a5-e93a-4648-bfb1-151fea84c4dc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.0806711 May 25 15:57:36.364208 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ead88aa8-bfe9-4d80-aa0d-f09eb8bb4a0d req-01fa8559-28c9-4dd5-b122-adf3c46ae52b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437284 May 25 15:57:36.413477 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-490c6cf1-5bdf-491d-b1dd-0d9c7e5c220b req-877f5d1b-a726-4e8e-a0ea-aa238f6a1229 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0425980 May 25 15:57:37.059372 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-ea9a7880-0788-4c6b-a5b0-88c6079389b5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:37.060099 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-ea9a7880-0788-4c6b-a5b0-88c6079389b5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:57:37.076103 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-ea9a7880-0788-4c6b-a5b0-88c6079389b5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:57:37.077206 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-ea9a7880-0788-4c6b-a5b0-88c6079389b5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.0948181 May 25 15:57:37.216744 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Deleting port fd471234-c522-4ab5-852b-64ca2a29444b {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:57:37.217078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:37.349338 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] For port fd471234-c522-4ab5-852b-64ca2a29444b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fd471234-c522-4ab5-852b-64ca2a29444b,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:57:37.349689 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:37.474648 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Calling delete_port for fd471234-c522-4ab5-852b-64ca2a29444b owned by compute:nova {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:57:37.583690 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d656d948-84ff-42dd-90c7-ccd116c00168 req-c3dbdafe-0e05-4809-9ef0-78e9336ae3a5 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0556762 May 25 15:57:37.590017 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:37.597262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e23b7c6e-8e0e-4494-97dd-1fefbfe8bf1c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:57:37.616490 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1d5263-0a31-4e17-a26c-9306fd5a91f5 req-13f516cd-1fed-4a5c-a3f6-cc8b03069876 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:37.618047 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4b1d5263-0a31-4e17-a26c-9306fd5a91f5 req-13f516cd-1fed-4a5c-a3f6-cc8b03069876 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 946 time: 0.1446455 May 25 15:57:37.629449 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'fd471234-c522-4ab5-852b-64ca2a29444b'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:57:37.643519 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event deleted for resources: {'Port': ['ID=fd471234-c522-4ab5-852b-64ca2a29444b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:57:37.690181 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.690552 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.690917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.691278 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.691715 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.692243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.692601 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.692954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.693316 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.693703 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.694054 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.694401 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:57:37.707920 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4b1d5263-0a31-4e17-a26c-9306fd5a91f5 req-e6da8a82-a7be-4896-8a57-c4d35b6a074e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810719 May 25 15:57:37.728156 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:57:37.742599 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] No DVR routers for this DVR port fd471234-c522-4ab5-852b-64ca2a29444b on host hv-cinder-78638 {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:57:37.745099 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:37.748293 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'name': 'network-vif-deleted', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:57:37.763230 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-7aa758c8-39a3-4f95-8539-8c672f024e91 req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "DELETE /v2.0/ports/fd471234-c522-4ab5-852b-64ca2a29444b HTTP/1.1" status: 204 len: 173 time: 0.6791327 May 25 15:57:37.798430 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27f04991-db0a-4e69-8f70-68aa76fc07dc', 'name': 'network-vif-deleted', 'tag': 'fd471234-c522-4ab5-852b-64ca2a29444b', 'status': 'completed', 'code': 200} May 25 15:57:38.734819 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-04427bc0-66b8-4a18-a63c-b7432912dac2 req-f5d666c1-c2df-4554-82ea-3a4cfd5b1349 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0434153 May 25 15:57:38.852145 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-53d78c61-2087-4495-b394-d735016a7a7f req-3465421c-c92e-45ef-9944-d62ebc96df8a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0449831 May 25 15:57:39.880060 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-812c11c8-bdeb-4f43-815f-7fc31d3f83f4 req-a358ed71-8f5d-4937-bdae-0b0c69e759b1 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0425923 May 25 15:57:39.999719 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3c724780-bf98-47c1-b7d8-0f2af954bcce req-e234a5f8-7a99-49b6-8665-565afe53d393 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0412040 May 25 15:57:39.999991 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fd471234-c522-4ab5-852b-64ca2a29444b no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:57:40.036020 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: fd471234-c522-4ab5-852b-64ca2a29444b {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:57:40.036383 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fd471234-c522-4ab5-852b-64ca2a29444b not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:57:41.031982 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2e07e0c4-0a76-4682-a860-3f68b2dd563f req-e5fe7b54-3ec6-450d-b1b0-5a213459b82a tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0448167 May 25 15:57:41.151679 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-be99d7b1-94c1-4625-a1a7-a076ccf040b2 req-197ea5d0-f64a-43d8-81f3-b16f187358ec tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0413926 May 25 15:57:42.181738 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aa335510-8af0-47b0-9e8c-f136156fbf66 req-bff9a55e-e7aa-49a7-bc2a-16ad6e0ecf4d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0420656 May 25 15:57:42.310589 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9a1db9b0-2dcb-4722-bd16-0ad732b5fb21 req-4678b53d-a4a6-4f7f-b0f7-63d7550ebd88 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0468180 May 25 15:57:43.334205 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a385e3fc-2509-415f-877c-089872698f43 req-c31e4d5d-4e56-42e7-9e4d-192befb1d5df tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0435150 May 25 15:57:43.461005 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f5734a5-53e5-4e55-83ec-973820487434 req-ca55ae9b-8010-4603-bfc0-4c47bb4ce0bd tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0438583 May 25 15:57:44.501798 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b4f1f579-ebf1-4a6a-a62d-4d34f0b5967a req-54d81c02-7a65-444b-bfd1-702209fca4af tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0483513 May 25 15:57:44.620498 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8df57ded-5e01-41d9-ae87-23b5bedd3738 req-c852fdc8-e664-4818-819c-757682964c09 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0425868 May 25 15:57:45.659834 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2bc28bae-4efc-4929-8ab8-45b9091f38c8 req-e2ca238e-6a84-4b42-b5bc-5d5315fb5a11 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0432062 May 25 15:57:45.776432 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3ac67a19-cc80-4134-8947-e9af2fa64f69 req-9c1d23ce-2e7a-4d54-931f-b8a966a41651 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0451186 May 25 15:57:46.815909 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-405d33eb-ff3b-430e-84e5-5fd6651ec1af req-e1a0f2de-6288-47bf-b894-9c4b4bf03384 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0454960 May 25 15:57:46.929976 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ead95ec3-0dae-4836-bbfc-78147a99344f req-3f62ed0d-4214-44e7-921b-8b2392236b90 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0428238 May 25 15:57:48.081742 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d51ce13b-e87a-4c61-a92f-d710c176fa39 req-e73ee95a-16a9-434d-a46f-ebfc51ecaaf9 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.1600928 May 25 15:57:48.094498 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db41f036-086d-48b2-8c8c-402cffa786a4 req-680cf601-e6a2-4ea5-b94c-739ca3d311e4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0485182 May 25 15:57:48.962245 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-e2aaf291-5d65-4a2f-b9a7-99c151f13790 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1333508 May 25 15:57:49.078729 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-09d43dde-bb94-4b8f-8fd3-069b04cc46e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:49.080327 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-09d43dde-bb94-4b8f-8fd3-069b04cc46e0 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 1098 time: 0.0830388 May 25 15:57:49.263761 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d5668da-4152-416d-a559-2663faaedb14 req-8b25eb14-dd8a-4fbf-a346-fb94bcd125b8 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0676091 May 25 15:57:49.322409 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-527d300b-c52f-4566-be91-0d174d6dcce0 req-01b68cbf-ef5e-4507-b40b-0e1fb5bbd80d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0469854 May 25 15:57:49.344881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-e42117bf-fbae-40a1-9077-3abb7993ead2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:49.346442 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-e42117bf-fbae-40a1-9077-3abb7993ead2 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.2431695 May 25 15:57:49.422452 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-59a10a86-6085-4519-9e3f-713f449c308e service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 200 len: 217 time: 0.0677075 May 25 15:57:49.489539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-4abaaff5-656e-4115-9471-17cf1da6bae5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:57:49.490985 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-4abaaff5-656e-4115-9471-17cf1da6bae5 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0617702 May 25 15:57:49.539281 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-016bdb5c-bb7a-4a6c-802f-fc18a18aebc0 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409644 May 25 15:57:49.693529 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-b04684e8-9069-4308-bd29-f3d85f163ea3 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1472676 May 25 15:57:49.918346 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-a1a2f4e0-67e0-4bb6-b819-6cb93446cb69 req-df272baf-9323-4a9e-bb1b-fc74c1428cc7 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2170053 May 25 15:57:50.431842 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3ba034d6-f6a9-404e-b15b-95b35ad39be7 req-5d9dad2c-6a3c-4b53-a520-de47f3879a83 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0423744 May 25 15:57:50.534466 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c624f03c-abae-4d4e-bef7-4bb9ae0a83d6 req-b98d0ab4-b0da-4edb-89c6-50de9d1d2842 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0471256 May 25 15:57:51.590605 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aeb5f70e-eeec-480f-a782-1cf80cb83d26 req-8dea3568-3ac3-4c5d-89bb-888063154dd4 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0433412 May 25 15:57:51.753676 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0d1677bb-530e-41e5-8ecd-2726217ba3cf req-00ac8e5b-5150-4cda-97d6-4f869f15d134 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0485210 May 25 15:57:52.751575 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-730ce4bc-0f2a-4d65-b97b-49645abb8b32 req-af14b108-946b-49c3-84ea-5f98b9f177ff tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0478134 May 25 15:57:52.922526 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-853586f3-5c29-4d94-adce-1816cc98afae req-84d9d317-6d1b-4b19-9757-91665a250338 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0434582 May 25 15:57:53.932114 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8a7f641d-2e7f-4dde-be82-8412f61f0803 req-a75473eb-4943-4228-8edf-dce444b6e273 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0579491 May 25 15:57:54.173320 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a00be171-5804-4eea-b9fb-16ff6666bed4 req-0f43d323-d5a3-4dd5-b0ab-8228f0356b70 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0812273 May 25 15:57:55.123769 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b6551213-4d57-4ce2-884e-dff235918440 req-80ad9108-cce4-499f-b971-6ddb75db13ee tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0737104 May 25 15:57:55.404580 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6437788d-13a4-4f37-9b94-61dee32e2a80 req-53c7d485-7568-4176-ab48-941db3fd3fde tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0516138 May 25 15:57:56.353249 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f627c184-2b5d-498c-bf77-bbbe6b518048 req-5974792e-40c3-4908-9233-8a438cb41c28 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0501468 May 25 15:57:56.624127 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-64628afb-e7f1-40c1-bdb9-8618c9b0c493 req-4b535358-23eb-4650-b830-cd54f3e24c9c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0528326 May 25 15:57:57.594660 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ed032863-2d09-4c68-8f2a-6649724fc946 req-af7d36a9-bb9e-4e55-b5a3-2ed3514ca422 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0478606 May 25 15:57:57.857857 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c76f57d-ee73-45b1-abb6-b7293a9e2319 req-f07f259c-aa45-4d4a-a6e7-0f2944b66777 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0839868 May 25 15:57:58.752443 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fde1cdd0-2a98-4272-9e14-aecefe2b3d56 req-2a652914-c01d-429f-b060-0c89bc087a36 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0445728 May 25 15:57:59.028833 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fe07ca86-4c18-45a2-b0be-9fb267032bbb req-30df7403-2c79-49fa-94b4-afd2569fc162 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0451608 May 25 15:57:59.193950 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b4bb60eb-9ef5-4d1f-94ef-732473a33ddb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:59.965419 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9fa9695e-4c1b-4636-93a7-3ada9b214905 req-e2c5ac90-7c17-487c-8e9c-bde4d3626ce3 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0829589 May 25 15:58:00.259934 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a442dde0-6062-42da-a482-3ba5a1ed87c5 req-9aa21f83-9f81-4473-962c-245c60cdae41 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0493696 May 25 15:58:01.121488 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03f4bb59-1176-4733-86e7-4b69ae209d2e req-ff885b19-9795-44f4-8b9c-3a1c682d52c6 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0461481 May 25 15:58:01.499686 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bd2df242-0d2b-48c4-ac5c-3ea40ae31ce1 req-b8f37de2-77fa-4255-93e7-c8be06d1e911 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0491228 May 25 15:58:01.553870 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:01.705744 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e43de531-cb74-4c96-836f-7e4a9416f49b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:02.272936 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bab88768-2ca9-4777-9814-444a10240b2c req-be6db162-605e-452e-b521-f9bd8fadb7e3 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0434654 May 25 15:58:02.696507 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b5331da4-a5a9-4db1-9108-58cd8b920c5f req-a2db0480-8cdb-4209-9e61-274d565480c4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0703347 May 25 15:58:02.758884 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:03.441673 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5b1cb159-42a4-4ee2-8541-c65e08ee6b5e req-3577d9af-1a13-41cd-9a30-d765c1e06ab8 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0483725 May 25 15:58:03.880694 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5a23a66-0cb3-4e0c-af5e-edcc205a9cce req-4434b008-79a0-435b-850e-f9fe5c32aef2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0737817 May 25 15:58:04.472466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:04.638643 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7af4496a-6e6a-45ab-8e97-014bb2d8d167 req-266f5926-d565-4145-b005-e585a5601fdf tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0725887 May 25 15:58:05.076411 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3e2c2890-ba51-455e-bb37-3db3875679c7 req-6baf1588-420d-417e-8bd1-d9cc49b7e560 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0770640 May 25 15:58:05.822407 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1c6b6d47-4be8-4675-90f1-3a4cdafab598 req-08246f25-a217-4579-9762-71bce507adaa tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0709925 May 25 15:58:05.900415 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:06.263931 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3cff9085-6e4e-43d2-b3cf-711a26273cc3 req-b8603a9e-33e2-4b95-8829-3ac3362c4334 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0544419 May 25 15:58:07.187353 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-301baad7-9480-4b3d-86de-113443bfb2a7 req-42f891ba-d469-48b0-afab-48b23c5f0397 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.1829696 May 25 15:58:07.431691 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:58:07.493933 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3f3b2722-5d09-495d-9dc7-d6426b909f41 req-6de0af95-215d-4fb7-a0ea-90dca225b154 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0768912 May 25 15:58:08.359795 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-36efc04a-f9a1-450c-a21b-51db1e294bd6 req-968d129d-62ed-4846-8d21-d7cd79289682 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0487666 May 25 15:58:08.656971 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dc51d22e-2d3a-4e46-8c82-f4bac4b449d9 req-344771da-bfd4-4b48-8a0f-0cc4c10eef25 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0502145 May 25 15:58:09.595275 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5ba91eba-ecaf-4e6d-b3d1-43553c6dc3ba req-df7144a1-f006-4123-b618-a25d8ab1e873 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0469613 May 25 15:58:09.839035 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8a71046e-8bdf-4dda-bb7c-5f4f0a63afec req-31178e6f-74b2-456b-a425-03c003174a5f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0509734 May 25 15:58:10.764581 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fabf30a6-3396-4463-a66c-85638713ff9a req-8fae6b76-4e6b-4b07-aed3-f4efd70c9dfa tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0470762 May 25 15:58:11.033439 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ac9bc54f-66d7-4985-99e0-e8603e45f9ad req-f86436e6-ebfd-44b7-a704-ca05b6ab58f9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0535367 May 25 15:58:11.963719 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e27bfd3d-c8e0-49f8-81d9-e2b69a6e7a2d req-83b5cd66-95cd-4a0f-8b2f-a25a58897f12 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0442283 May 25 15:58:12.240433 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-11e6c399-3b0a-4701-8660-759de7ec6af8 req-174007a3-b7cb-42d5-a8a2-24af39dd3eca tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0866723 May 25 15:58:13.181354 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-372da5a8-1d9b-4e94-8e71-5db885ed0add req-92f9026a-a659-4257-a9ac-222b0516630d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0454381 May 25 15:58:13.451341 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cb254eac-7427-4274-837f-76cab07c781f req-81057e98-c90a-4d13-892a-7aad9bc28419 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0697916 May 25 15:58:14.344889 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0a67e270-4b51-4e60-9a24-b05a75290e3d req-111b02f2-6fd2-4f6f-bee5-725b60e61444 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0508814 May 25 15:58:14.632112 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0b283fd4-7a72-405c-8464-6efe5e601fa0 req-c776d39c-d438-409d-bb8c-5c1eba07b727 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0661976 May 25 15:58:15.549036 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-77ae09ab-c932-46fd-8e23-4699281d74d0 req-05be1e53-54e3-4c4b-912c-0e7b59867abd tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0455129 May 25 15:58:15.861291 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a4891a69-43db-4833-8c1c-e78a7abd357b req-18f9a857-b3c5-4673-9af2-2c8338dcadc4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0808699 May 25 15:58:16.740982 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fdc6e325-e566-4ea0-872a-c4b9d91a1825 req-3b2c071b-88a0-4d05-9bb4-7faf7cfa145e tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0593002 May 25 15:58:17.073011 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-597435c9-c313-45de-8aeb-f19ab1a8eb33 req-a1aad991-813d-4a84-a64b-f9d49f32c8c5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0624001 May 25 15:58:17.979246 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3810491d-ad11-46e1-96c3-740c6ab3089f req-f8af65a7-a520-48e0-8932-78d52e600779 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0841570 May 25 15:58:18.273335 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8b806de4-1f39-4f10-ad4f-2dd29a8702ae req-07bc5a49-e064-4c9c-b384-b6e2dfe0cdf5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0667624 May 25 15:58:19.159059 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-14d0a8e3-0660-4e78-912b-c4a57d7130a1 req-0765d566-7ac4-4da0-8265-4ba653efba30 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0443401 May 25 15:58:19.466041 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cd2ca835-2435-4a97-8744-7614fc668746 req-c96ccb64-83da-4a05-a385-78a34f8626c3 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0715921 May 25 15:58:20.387127 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-70940971-c334-476b-9a95-ebde12f9bf53 req-1c3c9ffc-4545-418a-afa6-95e89a917afd tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0494072 May 25 15:58:20.686254 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-27f6f0c7-0194-4c2d-877d-276fa046f152 req-33fe6276-6860-4a4f-8c1e-ec0ebd4437dd tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0475721 May 25 15:58:21.589921 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8cc8caaf-95d5-4607-8654-714af5aff4bc req-56f2e40e-ad63-4bdb-897c-1ee0fa28a324 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0494130 May 25 15:58:21.944087 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8589bd87-d6b3-4298-9107-4cdbadffc1d7 req-8dc683a2-52d7-43bb-b248-d0a895fe5d6e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0495989 May 25 15:58:22.824945 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0b0b66e5-39ca-4634-8655-b0ad9007a110 req-31089072-3099-457b-9a5e-0d05cf09aace tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0612190 May 25 15:58:23.180181 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ee44221d-85c3-4ebd-9a04-632eab2bff21 req-e167c946-b1a2-434a-b313-6602d016a21d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0694511 May 25 15:58:24.022858 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00935109-2ecd-4732-ae73-f0de002081c2 req-6249990f-ab5c-49f1-8f97-a7fdb720511c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0473375 May 25 15:58:24.410608 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-edf60345-ab8c-45d7-9275-2731edefbc5a req-4d5e326e-2d23-41da-9016-2e2f47ba29ff tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0554078 May 25 15:58:25.267218 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-13712b0d-ac56-4ecc-b46d-e17867321073 req-33afc03c-e1a5-43b3-9e11-42db1f287530 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0680206 May 25 15:58:25.587571 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ea4522ca-e2ff-4de6-b6a5-37e6f0e7f856 req-30f4554e-9f6d-4360-aab9-cb4f24187de1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0489817 May 25 15:58:26.497709 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-db0c09ea-6607-41ae-8416-77cbc7267deb req-28ab66b1-775e-4868-8500-3f314cb4d864 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0498309 May 25 15:58:26.860890 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0f2e3b25-1355-46ca-9a20-b030a6d73c82 req-57bac17b-36bd-4cf4-8375-1001ca742bb8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.1536837 May 25 15:58:27.686132 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3b14d292-b55c-4490-a272-54ed884ce525 req-e9be4e85-b0b4-4500-9428-30728c0cf474 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0471871 May 25 15:58:28.035582 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-066fb29f-f812-4675-85fe-c5ee0fbfc18c req-9883f87b-95c6-484d-a188-724a8658e768 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0439801 May 25 15:58:28.855578 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca23b58b-60ed-4e8c-8fb7-1a9e8b6ba03b req-f255179d-2c54-4260-a373-98ab64f4e24d tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0482016 May 25 15:58:29.194495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ee05ea3f-f630-4b79-ac66-07624bf6006d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:29.269590 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-39d39c78-3582-4a7b-83fa-e17a2c4bc8c9 req-45f9efb7-6f30-40cf-95a8-f59e30f15389 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0444651 May 25 15:58:30.049622 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-baf7e5b3-2acd-4f93-87be-9b66cbf14b0c req-0f1446ef-4225-4b7b-acc0-2445b5160f22 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0783617 May 25 15:58:30.435445 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-80eb7262-3a20-4c32-b953-abbe38749c3d req-3bf10420-4ad3-4151-9d06-bbde789af03b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0519767 May 25 15:58:31.248198 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4f459cc4-c6d7-4318-ada2-810a5d98cb01 req-f44645e7-45f7-408c-8615-05757e5f1567 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0737653 May 25 15:58:31.554540 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:31.672317 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3d45e2b-417a-4c09-939f-7605fc1e9977 req-b303f8d8-6f3f-4c59-8ee0-a5e3ee46cda5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0439932 May 25 15:58:31.701767 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d5bec696-4564-4661-bdbf-d22e9b1c5583 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:32.581486 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-38a73ae6-448e-4e4a-9bd2-0317938f68e1 req-3e3716ae-38ce-4345-bfa4-01604d82923c tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0461664 May 25 15:58:32.761578 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:32.837621 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b6ca673-a784-4a31-9d35-9a494232e2f3 req-e51b4632-306d-4127-9597-c6a9a308149b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0425477 May 25 15:58:33.760050 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5aab553d-1d5d-4f3e-8306-16a6fb0f9145 req-9ea75d42-91a4-4b23-b821-88607f8091f9 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0523932 May 25 15:58:34.093518 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9fff9e77-f1b9-4a1b-99ef-fc742e77562f req-bf07b68b-f0d7-4ff1-9036-ba383d9df00f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0594680 May 25 15:58:34.475484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:34.938607 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-026aab99-9ba6-4f04-ab16-724fd6bd4809 req-0a00f668-cbf5-480d-8932-bfe34388fd74 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0487912 May 25 15:58:35.403068 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-caa2607c-248c-4818-8383-bcaa534e1656 req-c271e57d-6e36-49f5-8601-1849c92eadf9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0431023 May 25 15:58:35.903245 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:36.113385 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c8a8faa3-b40f-402b-b467-f83b129ac1db req-1c214554-e129-4e48-976c-a6936e2db088 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] 10.222.0.25 "GET /v2.0/ports?device_id=f93b52e6-9c72-4a67-85cd-9e8e45ed2ba4 HTTP/1.1" status: 200 len: 210 time: 0.0497680 May 25 15:58:36.641691 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-28f732c6-455a-491b-9c70-be792b8f6514 req-7dd775e7-46f2-41c8-9fac-f709714e44af tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0707402 May 25 15:58:36.853872 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7720a97a-4862-4ef7-8c2b-63bfb648a69c req-44fae167-be9b-46ac-b06b-841cc8ccd828 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:36.855378 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7720a97a-4862-4ef7-8c2b-63bfb648a69c req-44fae167-be9b-46ac-b06b-841cc8ccd828 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.0923793 May 25 15:58:36.917729 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7720a97a-4862-4ef7-8c2b-63bfb648a69c req-68ae5516-51b0-4046-b371-268117732fa8 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509844 May 25 15:58:37.050100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24fd3992-e29b-4d85-b601-4eb0084d2bf1 req-689a8b22-a7fa-4ecc-83b6-16e50f46b449 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:37.051624 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-24fd3992-e29b-4d85-b601-4eb0084d2bf1 req-689a8b22-a7fa-4ecc-83b6-16e50f46b449 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.0953729 May 25 15:58:37.102457 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-24fd3992-e29b-4d85-b601-4eb0084d2bf1 req-b4aad305-a473-471a-9f02-fda7df65a8ab tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446830 May 25 15:58:37.328214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-95b21862-450f-4e7e-a0ab-8595501159c3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:37.328917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-95b21862-450f-4e7e-a0ab-8595501159c3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Synchronizing usage tracker for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:58:37.342051 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-95b21862-450f-4e7e-a0ab-8595501159c3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Unset dirty status for tenant:0b066f0c91e94675a5051ab935c145f5 on resource:port {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:58:37.343541 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-95b21862-450f-4e7e-a0ab-8595501159c3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.1064348 May 25 15:58:37.520753 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Deleting port c3f2d540-8269-4dae-aba9-dd94153728c1 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:58:37.521238 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:37.706304 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] For port c3f2d540-8269-4dae-aba9-dd94153728c1, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=c3f2d540-8269-4dae-aba9-dd94153728c1,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:58:37.707132 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:37.815796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-649dd635-cd16-4b78-aeab-dae3697c066f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:37.818164 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-649dd635-cd16-4b78-aeab-dae3697c066f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.1696956 May 25 15:58:37.990625 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-32e2b98f-c73d-4833-bd0a-ba1dddba4ab5 req-cb1663c9-7051-4752-a223-e58334b03630 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.1062605 May 25 15:58:38.035480 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.035880 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.036425 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.l3_db [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Floating IP a2f6a0bf-1789-4474-94a4-160bc348351f disassociated. External IP: 172.27.1.148, port: c3f2d540-8269-4dae-aba9-dd94153728c1. May 25 15:58:38.036896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Calling delete_port for c3f2d540-8269-4dae-aba9-dd94153728c1 owned by compute:nova {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:58:38.145111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Deleting port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:58:38.145768 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.183670 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.183922 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b876e4-8a59-497a-bc61-8a29063c4b0f req-756a04e4-dd7a-426e-8524-960b19cae1e3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:38.185932 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c1b876e4-8a59-497a-bc61-8a29063c4b0f req-756a04e4-dd7a-426e-8524-960b19cae1e3 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 946 time: 0.1330340 May 25 15:58:38.192947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-86627326-9e84-440d-acc2-2a7a6754a8a1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:38.276501 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'Port': ['ID=c3f2d540-8269-4dae-aba9-dd94153728c1,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:38.297101 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.297713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.298311 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.298904 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.299509 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.300155 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.300768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.301381 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.301960 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.302447 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.303031 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.303664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:38.321734 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c1b876e4-8a59-497a-bc61-8a29063c4b0f req-4b44e44b-bde7-404a-8cbc-c50cdd61342e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups?id=287cebae-437b-4eb0-858e-f16038051e6d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0883741 May 25 15:58:38.370778 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:38.408700 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] For port 3c24e981-4263-4e26-8e3f-289dd52b4ad8, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=3c24e981-4263-4e26-8e3f-289dd52b4ad8,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:58:38.409049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.627704 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:58:38.717019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3c4f2a-e946-4411-9df0-96f9022dfda8 req-a3c70a3a-4d85-432e-a682-1cea50c806f7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:38.718573 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c3c4f2a-e946-4411-9df0-96f9022dfda8 req-a3c70a3a-4d85-432e-a682-1cea50c806f7 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 946 time: 0.3709910 May 25 15:58:38.885968 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:58:38.894668 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4c3c4f2a-e946-4411-9df0-96f9022dfda8 req-63eaf044-3224-4570-8732-6e2fef3c4b87 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups?id=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1604047 May 25 15:58:38.913821 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.914210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:38.914574 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Floating IP 11217005-5b1f-4223-ad0b-abf36b6b6b46 disassociated. External IP: 172.27.1.235, port: 3c24e981-4263-4e26-8e3f-289dd52b4ad8. May 25 15:58:38.914879 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Calling delete_port for 3c24e981-4263-4e26-8e3f-289dd52b4ad8 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:58:38.915094 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:58:38.937564 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:58:38.938203 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:58:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:39.020887 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] No DVR routers for this DVR port c3f2d540-8269-4dae-aba9-dd94153728c1 on host hv-cinder-78638 {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:58:39.031027 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:39.038531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'name': 'network-vif-deleted', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:58:39.070729 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.74 "DELETE /v2.0/ports/c3f2d540-8269-4dae-aba9-dd94153728c1 HTTP/1.1" status: 204 len: 173 time: 1.7193358 May 25 15:58:39.101829 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:39.111009 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:39.127894 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4582aa36-f251-4d3b-9575-5d2a57866605', 'name': 'network-vif-deleted', 'tag': 'c3f2d540-8269-4dae-aba9-dd94153728c1', 'status': 'completed', 'code': 200} May 25 15:58:39.184341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'Port': ['ID=3c24e981-4263-4e26-8e3f-289dd52b4ad8,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:39.213035 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:58:39.269725 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.270289 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.270830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.271364 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.271868 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.272326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.272753 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.273247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.273700 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.274126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.274552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.275032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:58:39.288504 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:39.366682 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e96ec0a6-4f74-4004-9f01-b7fa5e7eee5c req-353a80d4-c8eb-4b3f-8d35-ff46b8338ab3 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0875723 May 25 15:58:39.544799 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-afbfee58-8808-466f-9b97-164a10b188f3 req-4c234ac1-569c-4805-8d5a-3084585dfc87 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/ports?device_id=4582aa36-f251-4d3b-9575-5d2a57866605 HTTP/1.1" status: 200 len: 210 time: 0.0895376 May 25 15:58:39.568292 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:58:39.700678 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:39.705050 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:58:39.714980 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:58:39.715745 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:58:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:39.840607 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:58:39.856430 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:58:39.878290 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:58:39.878947 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:58:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:40.021047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] No DVR routers for this DVR port 3c24e981-4263-4e26-8e3f-289dd52b4ad8 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:58:40.027691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:40.035066 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'name': 'network-vif-deleted', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:58:40.052999 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a79036a7-6cf8-4e86-89c4-dc39e59baa6e req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.74 "DELETE /v2.0/ports/3c24e981-4263-4e26-8e3f-289dd52b4ad8 HTTP/1.1" status: 204 len: 173 time: 2.2281494 May 25 15:58:40.115618 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:58:40.234080 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ff9b116a-8215-43a3-b4d5-867a5dbebb70 req-e7e05b2b-6917-47b2-96ee-0ab1517ec25f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Synchronizing usage tracker for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:58:40.239903 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 3c24e981-4263-4e26-8e3f-289dd52b4ad8 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:58:40.282594 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33121bea-d259-4ffa-968b-b10dfbe5eef6', 'name': 'network-vif-deleted', 'tag': '3c24e981-4263-4e26-8e3f-289dd52b4ad8', 'status': 'completed', 'code': 200} May 25 15:58:40.285310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-ff9b116a-8215-43a3-b4d5-867a5dbebb70 req-e7e05b2b-6917-47b2-96ee-0ab1517ec25f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Unset dirty status for tenant:dd09b4c567df401194ac3825fe2e3080 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:58:40.289633 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:58:40.294587 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ff9b116a-8215-43a3-b4d5-867a5dbebb70 req-e7e05b2b-6917-47b2-96ee-0ab1517ec25f tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/ports?device_id=33121bea-d259-4ffa-968b-b10dfbe5eef6 HTTP/1.1" status: 200 len: 210 time: 0.1447127 May 25 15:58:40.356634 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 3c24e981-4263-4e26-8e3f-289dd52b4ad8 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:58:40.356983 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 3c24e981-4263-4e26-8e3f-289dd52b4ad8 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:58:40.357419 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device c3f2d540-8269-4dae-aba9-dd94153728c1 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:58:40.401353 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: c3f2d540-8269-4dae-aba9-dd94153728c1 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:58:40.401698 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device c3f2d540-8269-4dae-aba9-dd94153728c1 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:58:40.521050 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:40.526786 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e775ac82-d4b5-427a-b16f-375e7adf43ba None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '6d2d8f03-a534-4b34-94da-7da100d11936', 'name': '', 'network_id': '132a5a94-c14e-4969-994e-837fe8b01394', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'mac_address': 'fa:16:3e:73:48:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:30Z', 'updated_at': '2021-05-25T15:41:50Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'subnets': [{'id': 'cc89f65d-3227-4230-ac5b-a3041bcec0e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:58:40.555524 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-84e8438a-a758-455d-9460-5b22cd105a2e req-960390fb-2143-492f-9c20-14a74bf535a5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0473208 May 25 15:58:40.723072 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 40370) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:40.748249 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:40.756118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:58:40.776641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:58:40.777925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T15:58:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:40.800365 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:40.834770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:40.846239 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a7aa401-375d-40c1-961a-d4c45b39b673 None None] New status for floating IP a2f6a0bf-1789-4474-94a4-160bc348351f: DOWN {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:58:40.911821 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:40.919389 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b29bc9c0-3a0d-4adc-a026-0c5cb51662bd tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:40.933984 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=287cebae-437b-4eb0-858e-f16038051e6d,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:40.937884 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:40.945034 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:40.949438 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "DELETE /v2.0/security-groups/287cebae-437b-4eb0-858e-f16038051e6d HTTP/1.1" status: 204 len: 168 time: 0.2217164 May 25 15:58:40.949771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 40374) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:40.967338 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.api.v2.resource [None req-b55aab72-2c02-44d5-b59f-734adcb90661 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] show failed (client error): The resource could not be found. May 25 15:58:40.971426 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b55aab72-2c02-44d5-b59f-734adcb90661 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "GET /v2.0/security-groups/287cebae-437b-4eb0-858e-f16038051e6d HTTP/1.1" status: 404 len: 347 time: 0.0176880 May 25 15:58:40.971426 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 40378) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:41.060207 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:58:41.316671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Deleting port 2febd123-59d6-4cd8-8a54-6f7891e10abd {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:58:41.317526 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.395535 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:58:41.399786 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034a816c-5aad-485b-9669-d3b494b386c1 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '15d1697c-ee7f-4919-b595-da6a79fd36cc', 'name': '', 'network_id': 'f2d88153-7a7c-4433-8f94-c27a6e5feb07', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'mac_address': 'fa:16:3e:16:7b:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:32Z', 'updated_at': '2021-05-25T15:41:47Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'subnets': [{'id': '139c7c04-45f8-44c4-90ec-3068f09f624c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:58:41.453282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.453517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.491163 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 40390) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:41.570142 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.604745 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.625044 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Calling delete_port for 2febd123-59d6-4cd8-8a54-6f7891e10abd owned by network:floatingip {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:58:41.674980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.682706 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:41.696078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:41.700461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:41.709437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.710870 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "DELETE /v2.0/security-groups/cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb HTTP/1.1" status: 204 len: 168 time: 0.2162006 May 25 15:58:41.714582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 40396) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:41.726688 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cee9f9da-710f-434b-aae9-22484adb509d None None] New status for floating IP 11217005-5b1f-4223-ad0b-abf36b6b6b46: DOWN {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:58:41.735021 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.api.v2.resource [None req-4985624c-9f69-479d-abb2-0b345cf4f7f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] show failed (client error): The resource could not be found. May 25 15:58:41.736036 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-4985624c-9f69-479d-abb2-0b345cf4f7f9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "GET /v2.0/security-groups/cac535c5-e6ad-4f36-bdbe-4b7f0e008bdb HTTP/1.1" status: 404 len: 347 time: 0.0203118 May 25 15:58:41.739065 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 40400) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:58:41.865159 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1ca26bea-f0b9-4e2e-9fb8-4f0c67366f19 req-6ac36d25-c159-42ed-b692-62337b80787c tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.1047063 May 25 15:58:41.894728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:41.898898 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:41.944300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Pushing event deleted for resources: {'Port': ['ID=2febd123-59d6-4cd8-8a54-6f7891e10abd,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:41.947809 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:42.008590 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Deleting port a6c40530-75a7-4fa0-b1aa-e95fd6651d03 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:58:42.009171 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.048343 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks [] for floatingip, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.062790 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.063925 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] 10.222.0.25 "DELETE /v2.0/floatingips/a2f6a0bf-1789-4474-94a4-160bc348351f HTTP/1.1" status: 204 len: 168 time: 1.0914459 May 25 15:58:42.229282 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.229765 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.367239 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Calling delete_port for a6c40530-75a7-4fa0-b1aa-e95fd6651d03 owned by network:floatingip {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:58:42.509511 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.513961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ca652fc1-d2cf-49b0-b192-f2e21b2e418e tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:58:42.561386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Pushing event deleted for resources: {'Port': ['ID=a6c40530-75a7-4fa0-b1aa-e95fd6651d03,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:58:42.564270 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:58:42.654487 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks [] for floatingip, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.671375 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:42.672516 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] 10.222.0.25 "DELETE /v2.0/floatingips/11217005-5b1f-4223-ad0b-abf36b6b6b46 HTTP/1.1" status: 204 len: 168 time: 0.9319782 May 25 15:58:43.020685 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a02739d6-4a4c-4208-8d0d-2a69f58402ba req-f454517f-c4ae-4d4d-a050-707c87f36ff8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0434260 May 25 15:58:44.187543 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-70924c72-550e-4ea2-ad51-2d0c107ab68a req-5962b02a-229f-4b4c-b1d1-1c6e65cdc24a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0465531 May 25 15:58:44.430868 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:58:45.332969 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-71c53d97-df6c-4fcb-a336-04e00f9e107a req-0b98cb1a-eb11-4ad7-8aa4-3b257e443f14 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0428429 May 25 15:58:46.484185 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d553544d-1949-4f30-887d-afdb45f04a78 req-8b80d636-23e9-4112-9422-e7bb3cc9d321 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0438216 May 25 15:58:47.645923 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-719a11fa-394d-40fc-865b-8ec6603352cc req-493896e9-9b7d-4c56-8f2b-c685c09b1fd4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0487738 May 25 15:58:48.838118 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-de2635b9-ddef-46eb-99bf-f03f1269267a req-c8334306-f5bb-47cb-b537-f72812256e11 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0770204 May 25 15:58:48.886003 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-69679dc3-20b9-46bc-9c1f-ac01e430421c service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0929744 May 25 15:58:48.996386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-56444fa3-a072-44a7-b84c-790c06bae586 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:48.997849 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-56444fa3-a072-44a7-b84c-790c06bae586 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=53352f5306c64e2191fc3770c3f34cb6&device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 1098 time: 0.0797341 May 25 15:58:49.153082 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-11210e4c-645b-4b74-982a-00e54e45d3d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:49.154526 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-11210e4c-645b-4b74-982a-00e54e45d3d2 service neutron] 10.222.0.74 "GET /v2.0/networks?id=e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 200 len: 919 time: 0.1363997 May 25 15:58:49.228116 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-96a3ef9a-9da4-407c-8eb0-c924ccb27513 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 200 len: 217 time: 0.0656247 May 25 15:58:49.293039 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-036b4185-04f9-4725-a379-18b76fce25d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:58:49.294477 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-036b4185-04f9-4725-a379-18b76fce25d9 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 200 len: 858 time: 0.0596128 May 25 15:58:49.352994 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-bde8d5ba-4128-455b-9aaa-441169bd055e service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=e2c8de13-6b38-480d-a253-7798199b43d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0509715 May 25 15:58:49.511820 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-7d3eedc7-e937-48d6-ae14-b67e988285c5 service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517253 May 25 15:58:49.767447 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b11c3ffe-e6b9-48be-8be7-99136b635a2a req-c0600405-3724-4ba6-8e98-44cf5abdc4ce service neutron] 10.222.0.74 "GET /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2465193 May 25 15:58:50.037425 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9b3874de-97e8-4109-a540-ddb18a7c9599 req-21612b93-d105-48a0-b77f-d99a3938ad52 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0796869 May 25 15:58:51.237079 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4a1c77b3-e57d-4b1f-bc8a-32ea4daaac7a req-0c244fa8-8f75-4cf5-9a1a-a1fea088e32e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0447934 May 25 15:58:52.466962 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-80bcda26-1deb-4f8a-b057-4f73735065c3 req-501328fa-7731-442d-b772-b625888e6d49 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0444012 May 25 15:58:53.628201 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-475d6a8d-e9c1-43b7-ae5a-68dbf4d2f922 req-7e67031a-979d-42a3-b6dd-12a66addefe8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0469854 May 25 15:58:54.781396 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b1dbc94d-303c-465f-9228-cf9436cea47f req-63879f42-c023-4b8f-b87a-a8bd88636959 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0458636 May 25 15:58:55.932712 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0b7219aa-6b3d-4822-ad1e-20099008f11a req-6bb9c3cd-9e9e-4ce0-ae4b-73601c0819f3 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0425098 May 25 15:58:57.084063 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3019e518-0658-45d7-8366-e908c5532624 req-f7ff9e7e-cc98-466e-a0ec-45cdeec27757 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0461886 May 25 15:58:58.237514 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-878f4cc3-821a-477f-bc40-fdf5df052c4b req-ea2a5140-b56c-4c6e-b06d-fac1c642f444 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0449979 May 25 15:58:59.189283 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cfc31fc1-6fd9-4b96-9785-ef24116075c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:59.421791 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67bf1e0e-492c-4713-b352-9143b2c583fe req-5797429d-94b7-48d1-9800-e4c27b993f03 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0709393 May 25 15:59:00.623773 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f40528ca-d5ec-42d6-b98b-07da910b5a88 req-ab7688b7-18bb-40d2-a9eb-452f6cc956c1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0817356 May 25 15:59:01.548996 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:01.711864 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4f41cf2b-fb27-40ec-8262-eaaf4f2560fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:01.808785 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-df7482bf-1e01-4e16-a932-42805eed6366 req-3118fbc5-07fa-453b-af3b-bb3e1844dd74 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0444486 May 25 15:59:02.764233 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:02.999786 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f60d1c38-298c-4c76-9079-329db3c37f5a req-521aaf46-0302-4ef1-8264-7cd1bd35c899 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0745971 May 25 15:59:04.179951 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6344343a-c1cc-4b03-abaf-a6e84a816f5c req-4bda75b5-3bbc-4f94-a211-22eeb1505114 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0562296 May 25 15:59:04.486480 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:05.368832 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f303e592-c326-47ec-9f39-380445865988 req-482a5087-7cd1-4bc8-b763-fe0ab4b35206 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0465701 May 25 15:59:05.921517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:06.567867 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d024a3bd-8bd9-47a1-905d-5a893673afc6 req-d8bd2021-6bd2-4104-9feb-b46a515b99d9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0744052 May 25 15:59:07.841075 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d48a4787-6fe2-4533-9f68-2327371c1246 req-392ab89f-1593-4e30-a51e-d0f48f2cda0e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0514050 May 25 15:59:09.075863 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-30ece462-3d96-4fdb-8aaa-bdc4a26c28b2 req-37e67099-8ae1-4c30-9ade-10e18e4bd985 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0468745 May 25 15:59:10.324000 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5f735459-1cf2-4e6f-96bf-8ccd79f866f2 req-bac8c26b-7108-4e97-bdaa-c980bd4caf1f tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0646303 May 25 15:59:11.503254 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d7abc9af-faf4-4f15-9003-bbfbbbd17215 req-d19b693a-1bf7-4cb9-a3e5-7d424469a4e1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0500093 May 25 15:59:12.724116 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a662b895-3242-4c5f-ba21-eb227ebd8751 req-681d2634-c487-44ef-84e1-d9cd5536cb5e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0824273 May 25 15:59:13.981905 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b504696c-02b3-4b65-8ac2-b1e48d380797 req-e4df49e1-4d36-42c1-9a73-f419c537ee3a tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0478268 May 25 15:59:15.138372 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a6507ff4-b471-4fa1-abea-7e676f1b9e74 req-c14041ce-d86d-40f5-bf87-acef673d625e tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0480862 May 25 15:59:16.298589 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-62e059ed-f4d7-42a5-afe9-f1ec524d1fe6 req-85348702-610c-41c4-aaa9-02de7b8fd613 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0462906 May 25 15:59:17.458406 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d1be1a2b-ca40-49a5-a886-5daa056b0569 req-197498fc-3ff4-4ccb-ad12-4091cd108837 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0445161 May 25 15:59:18.626349 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b176fbe-16a8-49b2-a8e1-e66fe6983389 req-9459e604-83a5-427e-acce-803e686bf8f5 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0490329 May 25 15:59:19.848721 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-189762ec-266b-4747-a4e4-6dc6b912993d req-f6978378-f42a-4f5c-88aa-f976e070dad1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0748734 May 25 15:59:21.053691 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6f60aeb4-29e3-4a9e-806a-f688b715505b req-9360d56b-95c0-4147-af9f-0330588c5d90 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0809028 May 25 15:59:21.432372 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:59:22.288454 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcc2db25-ce7e-417e-9351-a0e1e43bd140 req-4fae4329-78b7-4ef2-8532-d1705963f007 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0582325 May 25 15:59:23.526910 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-08d03719-3d29-4fbd-9e7e-f7c12c5b89e7 req-b9c10766-a1a3-40a0-90c7-276f4cffb0de tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0475583 May 25 15:59:24.744229 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-89c6b39e-a7b9-4db9-bdab-0ee94d7ff3aa req-d467b93c-2c77-4296-9497-dee15751b1c8 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0486739 May 25 15:59:25.970032 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b770bcf-12e1-4e08-8646-c119668e35eb req-e6aee56f-67f3-4f14-a24d-aba02f2b21cb tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0921593 May 25 15:59:27.149461 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a69b1008-f46a-483b-8c33-bfcf35ba90c1 req-fceec2d6-0956-4c66-b4ba-7cd20b7760d9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0503402 May 25 15:59:28.392596 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fd8846ae-dcaf-4380-9f75-8683a58f5271 req-0f4dea84-f6c5-41b7-b8dd-f5851f89e6d0 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0549572 May 25 15:59:29.204581 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e994ac7b-489a-453a-bdde-96a424557a6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:29.648150 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-550e0c07-f3c9-4493-95de-814ccbcc5940 req-7fca5516-7e3d-4ffd-b350-bbd56fd7ab00 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0506938 May 25 15:59:30.860828 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ce6e9afb-3f77-4f3e-a9b4-eb4d2520b0d9 req-f9254384-6531-4ab6-81f0-0d04ab60bc6b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0772069 May 25 15:59:31.564114 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:31.718541 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-84535226-c56c-4d84-b99c-3105adf331cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:32.021488 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d355c291-29bd-4790-b453-ae3484b4bc77 req-057c5819-c398-4965-84c8-e7872e3400bd tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0447936 May 25 15:59:32.778484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:33.362565 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c28db926-ea2c-4cea-b23c-a5f21bb7e3ec req-9b1a9190-50d1-4825-a82d-e0a932724874 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.1551185 May 25 15:59:34.487101 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:34.582511 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-45a66cb1-11bd-4fd2-b2b5-57112447a2da req-e5de4f83-7266-4d8e-a4cf-3d76d20a0852 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0724411 May 25 15:59:35.797219 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b235a46d-5fa7-4933-9910-d1e9a6ff2673 req-e9017084-54cd-47e0-8dd3-aaaa0ae5f9f4 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0748992 May 25 15:59:35.937392 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:59:37.053365 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0f44368b-bbfc-4f21-80ff-70f4f4cd0aaf req-1bd23b94-6fe4-4049-b860-408ec9e3580d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0807621 May 25 15:59:38.228048 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7cd962d3-a9d6-4b9d-9749-0e11a59f71d8 req-439ff78d-7a1f-4e7f-8984-d7642aa6d6e2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=27f04991-db0a-4e69-8f70-68aa76fc07dc HTTP/1.1" status: 200 len: 210 time: 0.0454724 May 25 15:59:49.927736 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-81847643-5c28-4cb8-8fcc-e8104ba62fa6 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1373303 May 25 15:59:50.094600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-c66bf3a9-9bdd-4fb8-8085-7b3522926075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:59:50.097356 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-c66bf3a9-9bdd-4fb8-8085-7b3522926075 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1099 time: 0.1319506 May 25 15:59:50.270325 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-69cad86a-2184-45da-bdd8-2a01a953996a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:59:50.272022 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-69cad86a-2184-45da-bdd8-2a01a953996a service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1485145 May 25 15:59:50.398697 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-5dcfdb5d-bce3-4bec-96c6-f09084f5074f service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 200 len: 217 time: 0.1185751 May 25 15:59:50.500648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-c6662d57-bd07-44c2-8caa-abd2c8f0ce0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:59:50.502139 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-c6662d57-bd07-44c2-8caa-abd2c8f0ce0d service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0975552 May 25 15:59:50.578516 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-94c19e7d-8740-44ff-8252-2a9347b7439e service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0686505 May 25 15:59:50.727685 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-2d04d7fd-29eb-4e30-adcf-e7d056a49ccd service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405313 May 25 15:59:50.885083 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13bd572-e6a8-42e2-8ff5-1c31f5b7aa5a req-94fd7b09-605e-4f87-8aab-ec0380de4fc5 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1503367 May 25 15:59:58.436855 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:59:59.202009 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c17b8052-a6f4-43f1-9ce1-63a911f356de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:01.568577 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:01.707391 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b0827192-7462-47de-93dd-d64eba6832e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:02.779278 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:04.490837 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:05.927464 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:29.205684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1c5fb7b0-b1e2-4e3f-8a5f-273b8bd16c39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:31.564755 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:31.702366 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-07a050a8-2ba6-46da-a7b2-fca5c0a19991 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:32.772927 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:34.486204 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:35.435536 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:00:35.927241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:00:52.008698 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-3d9ea53b-c66e-4daf-89e2-e38cad23cb21 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0767200 May 25 16:00:52.115194 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e497356-b213-433f-890c-acf8c79a7788 req-4e9099a8-7505-43e0-bb05-2db97f78fd95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:00:52.116691 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-4e9099a8-7505-43e0-bb05-2db97f78fd95 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1098 time: 0.0728669 May 25 16:00:52.268167 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e497356-b213-433f-890c-acf8c79a7788 req-ce0a164f-a13a-45d1-ba60-868077362e8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:00:52.269516 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-ce0a164f-a13a-45d1-ba60-868077362e8b service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1334362 May 25 16:00:52.341435 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-e9fad6eb-a7ed-43f1-a050-a0d16a3df235 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 200 len: 217 time: 0.0650434 May 25 16:00:52.407341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e497356-b213-433f-890c-acf8c79a7788 req-a3968f51-57c3-492c-8bf3-e33665e2a9e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:00:52.408868 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-a3968f51-57c3-492c-8bf3-e33665e2a9e4 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0610292 May 25 16:00:52.461917 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-9483298d-1c64-4c7c-88bb-328d2b49bce2 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0463045 May 25 16:00:52.692947 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-4b03e5ed-2b5e-4755-a146-c0a54c1d5f45 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2234988 May 25 16:00:52.824229 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8e497356-b213-433f-890c-acf8c79a7788 req-1e59c073-d47e-4a8c-950e-0486040cf9bd service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242774 May 25 16:00:59.198953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7adba7b8-c2b8-4acb-88c4-cffa0f085668 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:01.570746 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:01.706497 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6b6b4330-008e-45c2-bb60-28185566e7f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:02.777187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:04.490663 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:05.937774 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:12.436670 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:01:29.203329 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dfbe8693-90cb-465c-ae2b-59ff0406cdfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:31.570157 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:31.710373 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7de39c4d-f161-4a6e-ac94-8953bf7e8a2e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:32.780923 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:34.492753 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:35.935696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:01:49.435072 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:01:59.212744 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6dfbd66b-b8bc-4854-a139-2ce8ee69ee58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:01.574813 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:01.715572 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8a4ae67b-3bd2-4c7e-a815-0778d9e49ae6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:02.785010 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:04.497023 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:05.941299 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:26.440021 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:02:29.207387 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9bfb7d71-f6b5-42d2-a7a7-5aba53119dd1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:31.575944 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:31.719486 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-20f6ed0c-1771-42cb-8656-4fc622158847 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:32.791434 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:34.508147 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:35.968446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:39.683582 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb7dbb9-1b43-4f79-be17-7da390c2baf7 req-5ed6ca1e-2bc3-4da3-9792-431a046a690d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:39.684956 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8cb7dbb9-1b43-4f79-be17-7da390c2baf7 req-5ed6ca1e-2bc3-4da3-9792-431a046a690d tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1675835 May 25 16:02:39.733456 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8cb7dbb9-1b43-4f79-be17-7da390c2baf7 req-5072b231-07c9-4ab9-b60b-9b1efb60dba7 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415595 May 25 16:02:40.161436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-020efadf-2647-4845-81df-1f756f817c9b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:40.163064 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-020efadf-2647-4845-81df-1f756f817c9b tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 945 time: 0.1009653 May 25 16:02:40.346357 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Deleting port 470d8e34-1962-4b04-9960-85526f36bc84 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:02:40.346785 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:40.505856 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] For port 470d8e34-1962-4b04-9960-85526f36bc84, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=470d8e34-1962-4b04-9960-85526f36bc84,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:02:40.506220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:40.637824 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Calling delete_port for 470d8e34-1962-4b04-9960-85526f36bc84 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:02:40.792779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:40.801943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:40.836155 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['6b61c077-8a57-453b-88d9-aaea2e17596f', '470d8e34-1962-4b04-9960-85526f36bc84'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:02:40.855796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Pushing event deleted for resources: {'Port': ['ID=470d8e34-1962-4b04-9960-85526f36bc84,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:40.866641 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.867022 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.867394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.867927 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.868298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.868695 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.869052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.869436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.870073 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.870650 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.871032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.871390 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:40.882408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:40.964723 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] No DVR routers for this DVR port 470d8e34-1962-4b04-9960-85526f36bc84 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:02:40.967253 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:41.004648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'name': 'network-vif-deleted', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:02:41.040886 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-87ec18d8-3dd3-4118-b881-1eba136d9f5b req-83b2deeb-5f20-486a-b52e-1bf30f2e5725 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Synchronizing usage tracker for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:02:41.044916 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c42a4338-df88-4a47-aeed-88f097a6b486 req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "DELETE /v2.0/ports/470d8e34-1962-4b04-9960-85526f36bc84 HTTP/1.1" status: 204 len: 173 time: 0.8749678 May 25 16:02:41.067697 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b56ced9a-a0ff-4098-a8e5-47491051fb16', 'name': 'network-vif-deleted', 'tag': '470d8e34-1962-4b04-9960-85526f36bc84', 'status': 'completed', 'code': 200} May 25 16:02:41.069122 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-87ec18d8-3dd3-4118-b881-1eba136d9f5b req-83b2deeb-5f20-486a-b52e-1bf30f2e5725 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Unset dirty status for tenant:53352f5306c64e2191fc3770c3f34cb6 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:02:41.070599 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-87ec18d8-3dd3-4118-b881-1eba136d9f5b req-83b2deeb-5f20-486a-b52e-1bf30f2e5725 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=b56ced9a-a0ff-4098-a8e5-47491051fb16 HTTP/1.1" status: 200 len: 210 time: 0.1941156 May 25 16:02:42.566624 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b8d4bc-37b8-49e6-97ce-96650013ab45 req-889246d7-3064-4f8c-81b1-5cc7431691fe tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:42.568245 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-55b8d4bc-37b8-49e6-97ce-96650013ab45 req-889246d7-3064-4f8c-81b1-5cc7431691fe tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0852242 May 25 16:02:42.619208 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-55b8d4bc-37b8-49e6-97ce-96650013ab45 req-b274b6b5-46f9-4391-9df3-efb12b79a48f tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/security-groups?id=00365c48-5483-4397-bb25-b532a8407a6f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442584 May 25 16:02:43.086526 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-b67e6d6b-5093-4e12-b878-b242c516e1b4 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:43.087970 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-b67e6d6b-5093-4e12-b878-b242c516e1b4 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 945 time: 0.0875096 May 25 16:02:43.238210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Deleting port 6b61c077-8a57-453b-88d9-aaea2e17596f {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:02:43.238615 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:43.320159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 470d8e34-1962-4b04-9960-85526f36bc84 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:02:43.357451 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 470d8e34-1962-4b04-9960-85526f36bc84 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:02:43.357807 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 470d8e34-1962-4b04-9960-85526f36bc84 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:02:43.377151 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] For port 6b61c077-8a57-453b-88d9-aaea2e17596f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=6b61c077-8a57-453b-88d9-aaea2e17596f,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:02:43.377530 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:43.598447 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Calling delete_port for 6b61c077-8a57-453b-88d9-aaea2e17596f owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:02:43.737436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:43.745227 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:43.780129 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['6b61c077-8a57-453b-88d9-aaea2e17596f'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:02:43.840219 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Pushing event deleted for resources: {'Port': ['ID=6b61c077-8a57-453b-88d9-aaea2e17596f,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:43.871282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:43.873800 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-24ac349a-469f-4808-b052-79c1a15350cd req-f19bf423-a4cd-4398-aede-3a1001cb9871 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.25 "GET /v2.0/ports?device_id=4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd HTTP/1.1" status: 200 len: 210 time: 0.1296091 May 25 16:02:43.923262 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] No DVR routers for this DVR port 6b61c077-8a57-453b-88d9-aaea2e17596f on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:02:43.926387 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:43.929050 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'name': 'network-vif-deleted', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:02:43.946410 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13066dc-66e4-416a-a84f-c1149ae97510 req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] 10.222.0.74 "DELETE /v2.0/ports/6b61c077-8a57-453b-88d9-aaea2e17596f HTTP/1.1" status: 204 len: 173 time: 0.8525879 May 25 16:02:43.980295 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c452f4c-2cd8-4d89-b56f-c4ab1b488bfd', 'name': 'network-vif-deleted', 'tag': '6b61c077-8a57-453b-88d9-aaea2e17596f', 'status': 'completed', 'code': 200} May 25 16:02:44.974350 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 42694) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:45.783274 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:46.191857 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Deleting port f5c01938-0a49-4160-8b18-b2c171ad66ac {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:02:46.192547 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:46.325574 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] For port f5c01938-0a49-4160-8b18-b2c171ad66ac, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=f5c01938-0a49-4160-8b18-b2c171ad66ac,segment=NetworkSegment(dca04af7-3ba4-4736-9f48-ea4624485914),segment_id=dca04af7-3ba4-4736-9f48-ea4624485914)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:02:46.325927 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:46.453028 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Calling delete_port for f5c01938-0a49-4160-8b18-b2c171ad66ac owned by network:router_interface {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:02:46.756288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:46.763963 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f047f26e-b922-4126-b508-e005775cc087 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:46.817698 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Pushing event deleted for resources: {'Port': ['ID=f5c01938-0a49-4160-8b18-b2c171ad66ac,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:46.856287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.856667 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.857024 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.857376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.857723 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.858072 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.858418 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.858759 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.859102 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.859442 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.859807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.860143 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:02:46.890038 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:47.201167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:47.333591 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 6b61c077-8a57-453b-88d9-aaea2e17596f no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:02:47.372814 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 6b61c077-8a57-453b-88d9-aaea2e17596f {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:02:47.373111 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 6b61c077-8a57-453b-88d9-aaea2e17596f not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:02:47.568543 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:02:47.762313 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:02:47.775595 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Sync routers for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:02:47.779795 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f67f4316-afe5-4733-ade8-e8b823b60d35 admin admin] 10.222.0.25 "PUT /v2.0/routers/15be0d6a-9ac8-468d-a5d9-0a6d6ce95956/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8018055 May 25 16:02:47.780929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 42722) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:47.799870 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:02:47.801528 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:02:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:48.001563 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:48.031194 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:02:48.182134 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:48.267072 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Deleting port 6f262988-6838-4979-94fe-63855563e32b {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:02:48.268052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:48.319232 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116'}], 'enable_snat': True}, 'gw_port_id': '6f262988-6838-4979-94fe-63855563e32b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T16:02:46Z', 'revision_number': 5, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port': {'id': '6f262988-6838-4979-94fe-63855563e32b', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9c:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.116', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:48.327248 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Checking router: 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:02:48.336767 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Routers {'15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:02:48.337250 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:02:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:48.402895 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] For port 6f262988-6838-4979-94fe-63855563e32b, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6f262988-6838-4979-94fe-63855563e32b,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:02:48.403432 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:48.493897 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] Set router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:02:48.531910 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Calling delete_port for 6f262988-6838-4979-94fe-63855563e32b owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:02:48.600081 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T16:02:48Z', 'revision_number': 6, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:48.604440 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c978e1d-3589-475a-b0a6-be1b84041649 None None] The sync data for ids ['15be0d6a-9ac8-468d-a5d9-0a6d6ce95956'] in dv-cinder-786383-6-iscsi is: [{'id': '15be0d6a-9ac8-468d-a5d9-0a6d6ce95956', 'name': 'tempest-ServerRescueNegativeTestJSON-389735979-router', 'tenant_id': '53352f5306c64e2191fc3770c3f34cb6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:21Z', 'updated_at': '2021-05-25T16:02:48Z', 'revision_number': 6, 'project_id': '53352f5306c64e2191fc3770c3f34cb6', 'gw_port_host': None}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:02:48.693593 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:48.698106 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-18e483ef-116d-45c9-b759-6c13e274e895 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:48.748652 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Pushing event deleted for resources: {'Port': ['ID=6f262988-6838-4979-94fe-63855563e32b,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:48.752121 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:48.852779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.139223 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.141567 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.169521 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.170222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:02:49.185711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.186880 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] 10.222.0.25 "DELETE /v2.0/routers/15be0d6a-9ac8-468d-a5d9-0a6d6ce95956 HTTP/1.1" status: 204 len: 168 time: 1.4040754 May 25 16:02:49.189463 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 42736) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:49.252471 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Deleting subnet 0eddaf48-c485-4fd6-aa56-c8209ff2711a {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:02:49.255992 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.306450 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.368999 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.637840 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.646961 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-dfbf6a33-4fc6-4034-98d2-b371c957dc90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:49.691016 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.694423 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0eddaf48-c485-4fd6-aa56-c8209ff2711a,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:49.697874 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:49.701642 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-54063fd2-5a49-4444-9e80-81f65fb0079d admin admin] 10.222.0.25 "DELETE /v2.0/subnets/0eddaf48-c485-4fd6-aa56-c8209ff2711a HTTP/1.1" status: 204 len: 168 time: 0.5103889 May 25 16:02:49.703966 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 42742) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:49.820000 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.981857 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:49.996975 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e2c8de13-6b38-480d-a253-7798199b43d7']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:50.017203 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dca04af7-3ba4-4736-9f48-ea4624485914') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:50.018473 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dca04af7-3ba4-4736-9f48-ea4624485914') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:02:50.034958 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.054927 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.063648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Releasing vlan 845 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:02:50.064167 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:02:50.084062 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:02:50.186579 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.193717 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:50.211139 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.217554 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Pushing event deleted for resources: {'Network': ['ID=e2c8de13-6b38-480d-a253-7798199b43d7,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:50.222625 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:50.230789 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] 10.222.0.25 "DELETE /v2.0/networks/e2c8de13-6b38-480d-a253-7798199b43d7 HTTP/1.1" status: 204 len: 168 time: 0.5257664 May 25 16:02:50.246042 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device f5c01938-0a49-4160-8b18-b2c171ad66ac no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:02:50.282202 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: f5c01938-0a49-4160-8b18-b2c171ad66ac {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:02:50.282549 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device f5c01938-0a49-4160-8b18-b2c171ad66ac not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:02:50.284009 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6f262988-6838-4979-94fe-63855563e32b no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:02:50.323843 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 6f262988-6838-4979-94fe-63855563e32b {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:02:50.324427 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6f262988-6838-4979-94fe-63855563e32b not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:02:50.424451 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 42754) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:50.482946 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-72bc4b18-02d3-4d52-abf6-93b3049143df admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=53352f5306c64e2191fc3770c3f34cb6&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0572224 May 25 16:02:50.485589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 42758) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:02:50.554501 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.586050 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.649489 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.653569 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a447db6f-1de3-4c24-b104-bfab80decbef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:02:50.668530 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00365c48-5483-4397-bb25-b532a8407a6f,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:02:50.671367 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:02:50.680787 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:02:50.682469 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/00365c48-5483-4397-bb25-b532a8407a6f HTTP/1.1" status: 204 len: 168 time: 0.1956468 May 25 16:02:54.976922 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-26efc4c5-a7ad-4f90-83d6-2729fd5341ed service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2235460 May 25 16:02:55.159957 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-dd028c36-4c1a-4b17-a860-6aa4d7d5ed37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:55.161443 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-dd028c36-4c1a-4b17-a860-6aa4d7d5ed37 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0838888 May 25 16:02:55.340106 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-62f07a73-b2f5-4aaf-b52d-53b79cd6735a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:55.341692 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-62f07a73-b2f5-4aaf-b52d-53b79cd6735a service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1586850 May 25 16:02:55.426092 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-315f66b1-f625-4fb1-a877-790281afc2b8 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0771191 May 25 16:02:55.606037 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-982e271d-0741-48b7-9a0c-f441b52b3abe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:02:55.607592 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-982e271d-0741-48b7-9a0c-f441b52b3abe service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.1753566 May 25 16:02:55.663198 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-3ffd0a08-83fc-46b5-a640-341c6a00ce17 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0467668 May 25 16:02:55.675112 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-cfa63a7e-b363-4883-89cf-c5172f53e6d6 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:02:55.677373 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-cfa63a7e-b363-4883-89cf-c5172f53e6d6 service neutron] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0063884 May 25 16:02:55.830449 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-7081db43-72b7-42cc-8bce-95c0f173e6a6 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1456795 May 25 16:02:55.984960 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e09e203b-9ccd-4c2a-bef7-b18189d44562 req-fc67c8bf-3f40-410a-9ac0-7ef06b01d615 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1480467 May 25 16:02:59.220279 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7d563b31-16d8-456f-a8b6-2fe65e056b2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:01.569832 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:01.721202 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9150bcac-d130-4153-bbd1-86b7c9982108 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:02.788930 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:03.438065 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:03:04.509203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:05.966768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:29.218558 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-38287104-4f6b-4320-9391-ea92cd073991 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:31.588108 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:31.742248 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-0ee69dbe-60ab-450a-a0f5-045e15ccd41d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:32.794319 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:34.509078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:35.969837 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:03:40.437121 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:03:56.871393 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-2116bb95-06f2-408f-9812-f574170a5c26 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0761416 May 25 16:03:56.986450 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-3e6d1cf7-2fb5-408a-8992-5edd72c502d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:03:56.988000 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-3e6d1cf7-2fb5-408a-8992-5edd72c502d0 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 1099 time: 0.0824354 May 25 16:03:57.143600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-23ab907f-a8ca-4ba7-ae9e-50be6e096950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:03:57.145100 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-23ab907f-a8ca-4ba7-ae9e-50be6e096950 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1373343 May 25 16:03:57.222570 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-f6be9677-a05a-429c-aefb-69343919e199 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 200 len: 217 time: 0.0703864 May 25 16:03:57.289557 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-78f55bb0-dd2b-4ff5-bfbc-8e7efcb1ad28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:03:57.291155 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-78f55bb0-dd2b-4ff5-bfbc-8e7efcb1ad28 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0612979 May 25 16:03:57.339003 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-6ecefa31-b8cc-4ff5-81a9-8286da2f42b4 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406880 May 25 16:03:57.475669 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-392ada71-73c2-48cf-aaf5-12ed93bf8e1e service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1274438 May 25 16:03:57.607109 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2ced8a95-91f0-41b2-becd-b146d58fedba req-8663bcc2-543b-43c8-93e1-e0b59c4420dd service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247897 May 25 16:03:59.212968 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4c199b80-03c9-43f1-a3ae-4632d39e5a90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:01.573160 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:01.722176 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-836ad73e-48be-44f6-a72c-004c8d3b6eb7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:02.797579 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:04.509026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:05.982661 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:17.436205 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:04:29.217770 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ba8f51fa-482f-4c3c-83d2-a6c8089631db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:31.580478 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:31.725432 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-eef51c3b-56ce-4c06-b460-2925f07d9a65 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:32.802286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:34.523026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:36.023385 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:54.436825 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:04:58.884654 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-f9bbc61f-ccde-411a-8361-3a40140b4aa4 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0847995 May 25 16:04:58.990524 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-52f76fe0-0302-49fe-9ef4-ba7cdb804995 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:04:58.992055 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-52f76fe0-0302-49fe-9ef4-ba7cdb804995 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 1098 time: 0.0733047 May 25 16:04:59.146734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-4272a060-4be1-4a42-bf4b-81f756d30346 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:04:59.148209 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-4272a060-4be1-4a42-bf4b-81f756d30346 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1358230 May 25 16:04:59.219501 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-263dcb52-a3cd-4cdd-a5e9-5ece69770404 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:04:59.232812 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-aa1cd9ae-a672-4c5f-b122-44d56f42f3c6 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 200 len: 217 time: 0.0778282 May 25 16:04:59.300975 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-2c1d4188-c536-4fa7-a882-bb22185d8190 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:04:59.302406 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-2c1d4188-c536-4fa7-a882-bb22185d8190 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0624802 May 25 16:04:59.355108 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-fbcd0308-b1e9-469a-8ae6-c403a2fd8129 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0450418 May 25 16:04:59.596066 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-f34d8231-6e4e-43a9-b37c-af5449972c1f service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2298303 May 25 16:04:59.733170 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af871e82-5bcd-47ce-8d92-e9d7e05bcd5f req-8deaec1c-b9ac-444e-89bb-1647d4f1dae2 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306050 May 25 16:05:01.574288 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:01.728022 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-074a283a-ec55-4503-8860-2fc7e2b4d5a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:02.800227 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:04.518481 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:06.049200 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:29.215198 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2f42f32e-5702-4d67-9730-d9cfc566b570 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:31.435537 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:05:31.579886 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:31.731926 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-03d09cf3-4dde-4af4-a809-62649c1fecb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:32.804509 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:34.526861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:36.046204 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:40.289096 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13a0185-db62-45d7-91a7-695af302c5c3 req-162ca300-50f6-4879-9a2d-b5b71fc02fcb tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:40.290551 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f13a0185-db62-45d7-91a7-695af302c5c3 req-162ca300-50f6-4879-9a2d-b5b71fc02fcb tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0793777 May 25 16:05:40.339664 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f13a0185-db62-45d7-91a7-695af302c5c3 req-c7e357dd-71c9-4274-9471-d64a2ee6f3b7 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431986 May 25 16:05:40.977937 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-637f5903-79bf-45c9-97d3-7c9a8b0f12d2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:40.979329 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-637f5903-79bf-45c9-97d3-7c9a8b0f12d2 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.0817006 May 25 16:05:41.115936 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Deleting port fff1b5a9-eacd-47e1-8a7e-666b346d4163 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:05:41.116282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:41.253576 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] For port fff1b5a9-eacd-47e1-8a7e-666b346d4163, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=fff1b5a9-eacd-47e1-8a7e-666b346d4163,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:05:41.253923 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:41.383009 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Calling delete_port for fff1b5a9-eacd-47e1-8a7e-666b346d4163 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:05:41.549437 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:41.556682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc8f7132-ed21-4589-9cbe-20f23f56c07e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:05:41.588724 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'fff1b5a9-eacd-47e1-8a7e-666b346d4163'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:05:41.608851 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event deleted for resources: {'Port': ['ID=fff1b5a9-eacd-47e1-8a7e-666b346d4163,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:05:41.646682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.647062 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.647430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.647852 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.648222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.648522 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.648873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.649223 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.649575 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.649924 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.650275 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.650626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:05:41.661893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:05:41.698692 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573bfbe9-7647-46ea-9859-8e432acbf49d req-48262ae8-3f5e-4e5e-a660-4fc8546c075b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:41.700200 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-573bfbe9-7647-46ea-9859-8e432acbf49d req-48262ae8-3f5e-4e5e-a660-4fc8546c075b tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=c81610c2-2830-4120-a62d-9f4dd4403866 HTTP/1.1" status: 200 len: 945 time: 0.2386973 May 25 16:05:41.726474 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] No DVR routers for this DVR port fff1b5a9-eacd-47e1-8a7e-666b346d4163 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:05:41.731320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:41.734521 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'name': 'network-vif-deleted', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:05:41.774279 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-282ee10d-be9b-427b-8384-857dcf5b9a68 req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "DELETE /v2.0/ports/fff1b5a9-eacd-47e1-8a7e-666b346d4163 HTTP/1.1" status: 204 len: 173 time: 0.7894456 May 25 16:05:41.813133 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-573bfbe9-7647-46ea-9859-8e432acbf49d req-659dca4d-260f-40bb-97e3-a2bc963ad692 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052897 May 25 16:05:41.939663 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c81610c2-2830-4120-a62d-9f4dd4403866', 'name': 'network-vif-deleted', 'tag': 'fff1b5a9-eacd-47e1-8a7e-666b346d4163', 'status': 'completed', 'code': 200} May 25 16:05:43.328093 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc2c7ee-7935-48a3-b317-07736991d2b7 req-904673bf-0647-4b9f-9210-516b08162d27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:43.328826 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-abc2c7ee-7935-48a3-b317-07736991d2b7 req-904673bf-0647-4b9f-9210-516b08162d27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:05:43.346184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-abc2c7ee-7935-48a3-b317-07736991d2b7 req-904673bf-0647-4b9f-9210-516b08162d27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:05:43.347519 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-abc2c7ee-7935-48a3-b317-07736991d2b7 req-904673bf-0647-4b9f-9210-516b08162d27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.1260490 May 25 16:05:43.397469 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-abc2c7ee-7935-48a3-b317-07736991d2b7 req-48854411-6d3a-4fcd-a692-c3bffd8f56e1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439181 May 25 16:05:43.809667 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-2406d557-fc18-4cd8-98fb-351319e2f31d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:43.811810 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-2406d557-fc18-4cd8-98fb-351319e2f31d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 946 time: 0.0802326 May 25 16:05:43.947953 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Deleting port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:05:43.948302 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:44.100588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fff1b5a9-eacd-47e1-8a7e-666b346d4163 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:05:44.137758 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: fff1b5a9-eacd-47e1-8a7e-666b346d4163 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:05:44.138102 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device fff1b5a9-eacd-47e1-8a7e-666b346d4163 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:05:44.175480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] For port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:05:44.175867 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:44.298393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Calling delete_port for d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:05:44.423825 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:44.429451 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:05:44.459775 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:05:44.476031 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event deleted for resources: {'Port': ['ID=d47929d4-f018-4b59-9ec6-ff3f8d1e44c5,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:05:44.512335 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:05:44.597017 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13b168d-3865-48e0-8243-86d99106f860 req-3ab6e735-e1f3-4ef6-9f70-3dff262d6e27 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b62ff8-9798-46a1-8435-2e98b8291f89 HTTP/1.1" status: 200 len: 210 time: 0.0833654 May 25 16:05:44.598570 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] No DVR routers for this DVR port d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:05:44.602421 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:44.607583 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'name': 'network-vif-deleted', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:05:44.635431 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-77b178e9-26a8-4da6-a1ef-00f04e4341b7 req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "DELETE /v2.0/ports/d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 HTTP/1.1" status: 204 len: 173 time: 0.8158205 May 25 16:05:44.668664 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1b62ff8-9798-46a1-8435-2e98b8291f89', 'name': 'network-vif-deleted', 'tag': 'd47929d4-f018-4b59-9ec6-ff3f8d1e44c5', 'status': 'completed', 'code': 200} May 25 16:05:48.098581 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:05:48.171015 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:05:48.171366 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d47929d4-f018-4b59-9ec6-ff3f8d1e44c5 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:05:58.842062 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-3e99b1ad-8877-4ad2-8636-2fb8938a9459 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0714538 May 25 16:05:59.003747 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-17fdb4b7-dbb5-45e6-a321-39d1b7a6b3cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:59.005276 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-17fdb4b7-dbb5-45e6-a321-39d1b7a6b3cc service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0737269 May 25 16:05:59.149704 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-1f2fc5f9-c2af-48ec-ac7f-cabddde2dfd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:59.151055 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-1f2fc5f9-c2af-48ec-ac7f-cabddde2dfd4 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1266785 May 25 16:05:59.218606 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6f57eca1-f87f-4e69-8b9d-7447fd7334db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:05:59.222452 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-df7c9914-3abb-43d3-83c0-8c3fb2b9c9ff service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0643549 May 25 16:05:59.286176 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-013a5055-4ee2-4f44-b6a7-4c3bcf62dd33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:05:59.287660 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-013a5055-4ee2-4f44-b6a7-4c3bcf62dd33 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0582974 May 25 16:05:59.339436 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-8b6d0b60-d7a8-4333-ab25-f71371d6ffa5 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0445123 May 25 16:05:59.472692 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-79b143f7-bd51-4227-912e-b5dfa51eca23 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265180 May 25 16:05:59.604118 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7a137f6-4d07-4479-a855-ad289fda22d2 req-395a5190-97ed-4acc-add7-44745fa8ca2f service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238024 May 25 16:06:01.582653 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:01.734467 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b67528ea-95e4-4f07-898c-0e3444559ac0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:02.806955 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:04.521744 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:06.054531 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:08.433835 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:06:29.222345 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dab3ab5c-f033-433c-b65a-db80be89a011 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:31.585842 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:31.736342 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-140d837b-3cd6-439a-b985-af9681782194 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:32.810069 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:34.529620 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:36.052197 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:45.432792 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:06:58.838761 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-25ecc32c-8b9b-4ea4-94f2-10e9291a5c8a service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0729694 May 25 16:06:59.001250 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-9af474c4-8659-481b-85d7-c1244014fe42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:06:59.002595 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-9af474c4-8659-481b-85d7-c1244014fe42 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0711296 May 25 16:06:59.152317 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-7e1e498b-06cb-4630-a149-1bb62de4f996 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:06:59.152317 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-7e1e498b-06cb-4630-a149-1bb62de4f996 service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1265428 May 25 16:06:59.224804 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-36d9e194-f94e-45e6-a3ff-d5bc8014ff6e service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0686336 May 25 16:06:59.226821 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-74638091-f56f-4ddc-969d-0372a8545487 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:06:59.295014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-f9cbc0d2-ccb0-4646-b728-b7c427776d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:06:59.296465 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-f9cbc0d2-ccb0-4646-b728-b7c427776d45 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0650246 May 25 16:06:59.347500 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-460739c4-15f5-473f-a1e5-8f333953720b service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0440686 May 25 16:06:59.571771 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-4e4fb5b0-48ee-4eb4-841a-b7bc00f48516 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2174244 May 25 16:06:59.704674 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0da2db5a-a63a-4bc0-a38a-85318e31847f req-4c6b5051-d86a-4c3e-b96d-d832f880e2ed service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256282 May 25 16:07:01.589784 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:01.737673 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-270f5b17-adbc-40a8-8e12-2e797b3eae63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:02.812525 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:04.526452 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:06.067339 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:22.431248 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:07:29.228964 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3ee820aa-dab3-4d0d-8a9b-7e409ac6190f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:31.593543 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:31.739993 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ee6bfaa4-45f7-4fa1-9f12-b90e5cbc2a7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:32.814435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:34.535340 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:36.083506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:59.230835 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e4150777-16ca-4f0e-a891-eadd0a4e5f4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:07:59.430037 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:08:00.867250 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-bd78b009-86da-4efe-80c7-b724e1747427 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1237435 May 25 16:08:01.038879 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d95525d-5698-413b-bc22-530f4c88085c req-c6f467b1-f30e-49cf-88af-5eefd2749c78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:08:01.040383 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-c6f467b1-f30e-49cf-88af-5eefd2749c78 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0767324 May 25 16:08:01.191632 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d95525d-5698-413b-bc22-530f4c88085c req-65c02a16-c181-4bfb-a6b7-0e8447cf8f8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:08:01.192977 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-65c02a16-c181-4bfb-a6b7-0e8447cf8f8f service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1304383 May 25 16:08:01.261506 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-ae45b7d6-5233-423a-929b-a04ee6de1169 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0614023 May 25 16:08:01.327752 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d95525d-5698-413b-bc22-530f4c88085c req-398e4d76-760c-417d-959d-3506a883b963 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:08:01.329175 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-398e4d76-760c-417d-959d-3506a883b963 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0608761 May 25 16:08:01.377670 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-41c9d02e-ae38-4365-a7c8-782b3131a022 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414298 May 25 16:08:01.519009 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-79bbe374-992b-41cd-ad45-df0bc989183f service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1341119 May 25 16:08:01.597748 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:01.654862 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6d95525d-5698-413b-bc22-530f4c88085c req-36bc0b63-86bf-444d-b05a-47f9f49d8602 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284313 May 25 16:08:01.742812 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-38813a7d-56fc-4038-b45d-593a263a7131 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:02.818840 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:04.526836 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:06.070689 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:29.233410 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f60695ec-9dd4-4f4b-aed1-6f0ca3760f63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:31.599270 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:31.744768 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-515f0734-1c46-429f-b346-52fb450b226a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:32.820595 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:34.529217 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:36.089298 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:08:36.429632 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:08:59.235622 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-fbf36998-bbf4-4552-a04b-9b4d2486660c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:01.604431 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:01.747594 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5327d773-7cad-4781-8080-263562ca5b76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:02.822223 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-88ac5462-1bd6-4066-8414-3fed5ec35909 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0743120 May 25 16:09:02.823885 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:02.984514 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-f6352281-5499-4f6c-b041-35b50de7df49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:09:02.986156 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-f6352281-5499-4f6c-b041-35b50de7df49 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0752034 May 25 16:09:03.149003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-aa58d773-65ed-408c-acae-eae70a2fa7fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:09:03.150450 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-aa58d773-65ed-408c-acae-eae70a2fa7fa service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1432211 May 25 16:09:03.222461 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-4299b1a6-182d-4977-9c34-9b340a4a6d2b service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0644338 May 25 16:09:03.286903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-770c9a9a-a4fd-4f2c-a1a9-0d64e80e70bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:09:03.288348 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-770c9a9a-a4fd-4f2c-a1a9-0d64e80e70bd service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0596094 May 25 16:09:03.335313 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-a47ee66f-da58-4166-ae13-44a6559b900a service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0397470 May 25 16:09:03.469140 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-a2582cbb-f779-4741-a67b-e80afc5df653 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265717 May 25 16:09:03.694032 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7e94b1da-becd-4e66-8dcc-8bc27252f972 req-9347336c-6c99-4fbb-8099-d1acd2888a3d service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2181067 May 25 16:09:04.531078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:06.128457 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:13.429057 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:09:29.236908 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d4e9948c-3de5-4371-b573-8de448aa9496 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:31.597945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:31.752207 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-21d2d475-7177-4c8a-912f-cc10d5dd03ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:32.832633 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:34.534126 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:36.129044 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:09:50.427333 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:09:59.240610 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b3e291c7-ac0e-4d21-9d5f-6bf5240772d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:01.601328 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:01.754321 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2d9c43d0-80c1-4f3a-8360-e9115d8add77 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:02.828462 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:02.994206 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-0052afff-1cae-4ed6-9596-f8be3ce35b2d service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0736837 May 25 16:10:03.143479 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-7bab511a-f741-49e7-af1f-eafe74479284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:10:03.145047 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-7bab511a-f741-49e7-af1f-eafe74479284 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0681283 May 25 16:10:03.290730 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-d3e8854b-5a19-4cb3-8fa7-9e1efbb86d7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:10:03.292233 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-d3e8854b-5a19-4cb3-8fa7-9e1efbb86d7e service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1281171 May 25 16:10:03.364658 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-28c912a6-5239-41e2-8b8d-6cbd73196c9d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0652468 May 25 16:10:03.428354 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-907f4c54-eaec-4c5d-b5be-5a246f2216dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:10:03.429781 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-907f4c54-eaec-4c5d-b5be-5a246f2216dc service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.0573683 May 25 16:10:03.478877 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-e30872cd-10e8-4cb6-a724-52ec52958e40 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0418212 May 25 16:10:03.609191 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-bc408a2e-6060-4dc0-9fe4-5bc1c1f60fa1 service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228781 May 25 16:10:03.742272 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-67d57667-f89c-4a1e-8dd2-a4ca4442a354 req-0105b9af-de97-4902-92c4-f6c1faf057fe service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257083 May 25 16:10:04.537485 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:06.133193 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:27.427005 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:10:29.243800 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ab84743b-9213-45c3-93c4-398e38735138 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:31.604053 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:31.756316 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1004a2ed-4a72-4e35-9307-a6600259cef3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:32.831241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:34.543020 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:36.148050 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:42.532683 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48158) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:42.975370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 48172) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:43.267940 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:43.624507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:43.803831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Deleting port 15d1697c-ee7f-4919-b595-da6a79fd36cc {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:43.804602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:43.934226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] For port 15d1697c-ee7f-4919-b595-da6a79fd36cc, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=15d1697c-ee7f-4919-b595-da6a79fd36cc,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:43.934580 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.059962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Calling delete_port for 15d1697c-ee7f-4919-b595-da6a79fd36cc owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:44.180138 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Deleting port 6d2d8f03-a534-4b34-94da-7da100d11936 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:44.180845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.224657 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.229201 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9a4223d2-7022-4f4d-98ae-6fd1229ea460 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:44.274110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Pushing event deleted for resources: {'Port': ['ID=15d1697c-ee7f-4919-b595-da6a79fd36cc,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:44.316310 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] For port 6d2d8f03-a534-4b34-94da-7da100d11936, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=6d2d8f03-a534-4b34-94da-7da100d11936,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:44.316835 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.351165 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.351650 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.352171 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.352594 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.353111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.353478 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.353902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.354318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.354732 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.355140 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.355580 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.355974 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.367122 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:44.451637 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Calling delete_port for 6d2d8f03-a534-4b34-94da-7da100d11936 owned by network:router_interface {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:44.580905 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.621668 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:44.626277 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2f64d6b4-c154-4c32-9ecc-3579d1e6a23c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:44.672138 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Pushing event deleted for resources: {'Port': ['ID=6d2d8f03-a534-4b34-94da-7da100d11936,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:44.718768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.719193 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.719512 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.719899 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.720255 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.720611 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.720961 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.721314 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.721664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.722013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.722358 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.722702 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:44.751225 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:44.979691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:45.158371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Router e15748c9-8f60-49f9-a768-dc9676a5b123 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:10:45.347788 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:10:45.357024 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Sync routers for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:10:45.361082 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] 10.222.0.25 "PUT /v2.0/routers/e15748c9-8f60-49f9-a768-dc9676a5b123/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8273046 May 25 16:10:45.363472 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48194) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:45.368172 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:10:45.368797 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:10:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:45.456717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:10:45.553749 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:10:45.554199 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:45.654581 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:10:45.663105 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Sync routers for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:10:45.675942 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] 10.222.0.25 "PUT /v2.0/routers/1010794f-cc62-4f17-9bac-e4a39ed5d7a5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6987276 May 25 16:10:45.679940 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:10:45.680116 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 48200) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:45.680595 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:10:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:45.752934 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:45.831272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Deleting port 57114f18-b5af-4c03-b3c4-d90bf7703373 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:45.831803 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:45.881461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks [] for router, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:45.923962 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127'}], 'enable_snat': True}, 'gw_port_id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T16:10:44Z', 'revision_number': 5, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port': {'id': '57114f18-b5af-4c03-b3c4-d90bf7703373', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:3b:5c:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:26Z', 'updated_at': '2021-05-25T15:41:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:45.928401 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Checking router: e15748c9-8f60-49f9-a768-dc9676a5b123 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:10:45.932021 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:10:45.938308 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Routers {'e15748c9-8f60-49f9-a768-dc9676a5b123'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:10:45.938951 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:10:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['e15748c9-8f60-49f9-a768-dc9676a5b123'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:46.015806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] For port 57114f18-b5af-4c03-b3c4-d90bf7703373, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=57114f18-b5af-4c03-b3c4-d90bf7703373,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:46.016196 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.144874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.177408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Calling delete_port for 57114f18-b5af-4c03-b3c4-d90bf7703373 owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:46.180826 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] Set router e15748c9-8f60-49f9-a768-dc9676a5b123 gateway port host: None {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:10:46.232364 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Deleting port 0bf5221e-392d-4673-990d-1644c22ab960 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:46.232768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.299728 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T16:10:45Z', 'revision_number': 6, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:46.302016 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101'}], 'enable_snat': True}, 'gw_port_id': '0bf5221e-392d-4673-990d-1644c22ab960', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T16:10:44Z', 'revision_number': 5, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port': {'id': '0bf5221e-392d-4673-990d-1644c22ab960', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:44:35:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:22Z', 'updated_at': '2021-05-25T15:41:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:46.304894 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50f1b8e2-14a4-4fc8-bf5c-fb0ae092d200 None None] The sync data for ids ['e15748c9-8f60-49f9-a768-dc9676a5b123'] in dv-cinder-786383-6-iscsi is: [{'id': 'e15748c9-8f60-49f9-a768-dc9676a5b123', 'name': 'tempest-AttachVolumeShelveTestJSON-1265756350-router', 'tenant_id': 'dd09b4c567df401194ac3825fe2e3080', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:23Z', 'updated_at': '2021-05-25T16:10:45Z', 'revision_number': 6, 'project_id': 'dd09b4c567df401194ac3825fe2e3080', 'gw_port_host': None}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:10:46.308425 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Checking router: 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:10:46.320123 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Routers {'1010794f-cc62-4f17-9bac-e4a39ed5d7a5'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:10:46.321101 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:10:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:46.344250 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.351056 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:46.395811 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] For port 0bf5221e-392d-4673-990d-1644c22ab960, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=0bf5221e-392d-4673-990d-1644c22ab960,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:46.396228 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.433225 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Pushing event deleted for resources: {'Port': ['ID=57114f18-b5af-4c03-b3c4-d90bf7703373,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:46.439306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:46.488150 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] Set router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:10:46.494348 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.528055 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Calling delete_port for 0bf5221e-392d-4673-990d-1644c22ab960 owned by network:router_gateway {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:46.597640 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T16:10:46Z', 'revision_number': 6, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:46.601824 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e373f-eb32-4d5c-9e9d-7c74b1c6a538 None None] The sync data for ids ['1010794f-cc62-4f17-9bac-e4a39ed5d7a5'] in dv-cinder-786383-6-iscsi is: [{'id': '1010794f-cc62-4f17-9bac-e4a39ed5d7a5', 'name': 'tempest-AttachVolumeTestJSON-189184680-router', 'tenant_id': '0b066f0c91e94675a5051ab935c145f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:20Z', 'updated_at': '2021-05-25T16:10:46Z', 'revision_number': 6, 'project_id': '0b066f0c91e94675a5051ab935c145f5', 'gw_port_host': None}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:10:46.701199 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.709021 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-edf90a52-8063-4d29-bd09-97e7873725fc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:46.770172 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Pushing event deleted for resources: {'Port': ['ID=0bf5221e-392d-4673-990d-1644c22ab960,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:46.797669 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.800126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.806347 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:46.828788 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.829783 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Fanout notify agent at l3_agent the message router_deleted on router e15748c9-8f60-49f9-a768-dc9676a5b123 {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:10:46.850202 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.852213 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] 10.222.0.25 "DELETE /v2.0/routers/e15748c9-8f60-49f9-a768-dc9676a5b123 HTTP/1.1" status: 204 len: 168 time: 1.4875197 May 25 16:10:46.854637 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48212) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:46.869737 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.923997 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Deleting subnet 139c7c04-45f8-44c4-90ec-3068f09f624c {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:10:46.926964 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:46.994396 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.083811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.159523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.161890 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.251205 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.251832 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1010794f-cc62-4f17-9bac-e4a39ed5d7a5 {{(pid=98391) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:10:47.265000 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.268290 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] 10.222.0.25 "DELETE /v2.0/routers/1010794f-cc62-4f17-9bac-e4a39ed5d7a5 HTTP/1.1" status: 204 len: 168 time: 1.5851271 May 25 16:10:47.268684 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 48222) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:47.334315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Deleting subnet cc89f65d-3227-4230-ac5b-a3041bcec0e2 {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:10:47.337854 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.353605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.358827 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26e679d4-651a-4a7b-9bcc-a9aa03219100 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:47.393109 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.393484 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=139c7c04-45f8-44c4-90ec-3068f09f624c,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:47.396130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:47.400693 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.405994 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4914542f-5117-4c7a-8b8e-77a17a8adf28 None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:10:47.410376 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a5095ef0-908a-4d60-81b9-be63feaae709 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/139c7c04-45f8-44c4-90ec-3068f09f624c HTTP/1.1" status: 204 len: 168 time: 0.5525434 May 25 16:10:47.410606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48226) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:47.518582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.526498 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.620855 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Deleting port 62db4b26-5b19-4262-87e1-6259d7e05e49 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:47.621203 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.735433 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 15d1697c-ee7f-4919-b595-da6a79fd36cc no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:47.757772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] For port 62db4b26-5b19-4262-87e1-6259d7e05e49, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=62db4b26-5b19-4262-87e1-6259d7e05e49,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:47.758135 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.773962 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] DHCP port deletion for f2d88153-7a7c-4433-8f94-c27a6e5feb07 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:10:47.782932 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 15d1697c-ee7f-4919-b595-da6a79fd36cc {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:47.783665 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 15d1697c-ee7f-4919-b595-da6a79fd36cc not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:47.880889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Deleting port 62db4b26-5b19-4262-87e1-6259d7e05e49 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:47.881368 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.881972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.887473 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e32f2613-ef0b-4873-8881-ae1a795ff7f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:47.895169 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Calling delete_port for 62db4b26-5b19-4262-87e1-6259d7e05e49 owned by network:dhcp {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:47.946042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.951008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc89f65d-3227-4230-ac5b-a3041bcec0e2,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:47.953076 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:47.954757 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:47.956933 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3b4fb66b-9557-471e-a4ec-8a5297d9da47 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:47.959072 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6beb0d6d-a65d-489d-a4aa-0abed9e4fcc5 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/cc89f65d-3227-4230-ac5b-a3041bcec0e2 HTTP/1.1" status: 204 len: 168 time: 0.6861978 May 25 16:10:47.959683 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 48232) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:47.995641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] For port 62db4b26-5b19-4262-87e1-6259d7e05e49, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=62db4b26-5b19-4262-87e1-6259d7e05e49,segment=NetworkSegment(2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da),segment_id=2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:47.996137 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.002236 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Pushing event deleted for resources: {'Port': ['ID=62db4b26-5b19-4262-87e1-6259d7e05e49,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:48.006372 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:48.009042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] No DVR routers for this DVR port 62db4b26-5b19-4262-87e1-6259d7e05e49 on host dv-cinder-786383-6-iscsi {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:10:48.082729 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.125909 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-385ff29a-d6b1-4799-b189-d7c4ba119c53 None None] Network 132a5a94-c14e-4969-994e-837fe8b01394 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:10:48.145926 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Calling delete_port for 62db4b26-5b19-4262-87e1-6259d7e05e49 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:48.146904 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.161542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2d88153-7a7c-4433-8f94-c27a6e5feb07']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.174703 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Deleting port 20644580-7d23-420c-865a-3231c7bc8205 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:10:48.175188 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.175420 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.178485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2aa9c88c-2815-47a8-a3ae-9ded6f3cd2da') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.192261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.211394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.218614 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Releasing vlan 800 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:10:48.219160 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:10:48.236911 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:10:48.313692 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] For port 20644580-7d23-420c-865a-3231c7bc8205, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=20644580-7d23-420c-865a-3231c7bc8205,segment=NetworkSegment(5d94defc-ad75-4154-8cd1-61c6b951613a),segment_id=5d94defc-ad75-4154-8cd1-61c6b951613a)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:10:48.314220 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.339773 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.344966 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7a3529f3-1ab9-4bdd-9f46-506e107e0571 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:48.371969 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.374687 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Pushing event deleted for resources: {'Network': ['ID=f2d88153-7a7c-4433-8f94-c27a6e5feb07,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:48.378372 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:48.379592 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.384801 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-e6b1ec29-cf34-4373-99fb-0bf3327e5509 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:48.390579 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] 10.222.0.25 "DELETE /v2.0/networks/f2d88153-7a7c-4433-8f94-c27a6e5feb07 HTTP/1.1" status: 204 len: 168 time: 0.9763625 May 25 16:10:48.421857 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Network f2d88153-7a7c-4433-8f94-c27a6e5feb07 is not hosted by any dhcp agent {{(pid=98393) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:231}} May 25 16:10:48.422449 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] No DVR routers for this DVR port 62db4b26-5b19-4262-87e1-6259d7e05e49 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:10:48.434802 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Pushing event deleted for resources: {'Port': ['ID=62db4b26-5b19-4262-87e1-6259d7e05e49,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:48.445229 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.445469 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.445803 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.446128 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.446450 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.447021 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.447337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.447709 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.448553 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.448874 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.449193 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.449715 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:10:48.453252 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:48.466790 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Calling delete_port for 20644580-7d23-420c-865a-3231c7bc8205 owned by network:dhcp {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:10:48.514170 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 0bf5221e-392d-4673-990d-1644c22ab960 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:48.524569 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.530242 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fb190f69-377b-4a72-8c0e-cbdd9aae3d64 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:48.544110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48244) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:48.560482 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 0bf5221e-392d-4673-990d-1644c22ab960 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:48.560833 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 0bf5221e-392d-4673-990d-1644c22ab960 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:48.561257 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6d2d8f03-a534-4b34-94da-7da100d11936 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:48.579827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Pushing event deleted for resources: {'Port': ['ID=20644580-7d23-420c-865a-3231c7bc8205,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:48.581660 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] No DVR routers for this DVR port 20644580-7d23-420c-865a-3231c7bc8205 on host dv-cinder-786383-6-iscsi {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:10:48.583136 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:48.590137 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b35ab008-4517-4167-9eb9-d45a75243086 None None] DHCP port deletion for 132a5a94-c14e-4969-994e-837fe8b01394 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:10:48.605350 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 6d2d8f03-a534-4b34-94da-7da100d11936 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:48.605762 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 6d2d8f03-a534-4b34-94da-7da100d11936 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:48.606138 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 62db4b26-5b19-4262-87e1-6259d7e05e49 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:48.618510 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6653ce9f-e695-4a5a-92ac-816bc8991f0d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=dd09b4c567df401194ac3825fe2e3080&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0696468 May 25 16:10:48.618822 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48248) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:48.642112 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 62db4b26-5b19-4262-87e1-6259d7e05e49 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:48.642740 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 62db4b26-5b19-4262-87e1-6259d7e05e49 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:48.643378 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 57114f18-b5af-4c03-b3c4-d90bf7703373 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:48.690781 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 57114f18-b5af-4c03-b3c4-d90bf7703373 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:48.691044 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 57114f18-b5af-4c03-b3c4-d90bf7703373 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:48.694237 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.724066 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.782312 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.786919 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c6e12a9a-edbc-47b2-9249-bba08fb85c2e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:48.800189 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e88a0fa9-0a06-4f49-aca1-a79164cf520e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:48.802652 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:48.810625 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.811855 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e88a0fa9-0a06-4f49-aca1-a79164cf520e HTTP/1.1" status: 204 len: 168 time: 0.1920722 May 25 16:10:48.832947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.847598 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['132a5a94-c14e-4969-994e-837fe8b01394']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.860035 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5d94defc-ad75-4154-8cd1-61c6b951613a') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.860330 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5d94defc-ad75-4154-8cd1-61c6b951613a') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:10:48.872184 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.888884 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.895454 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Releasing vlan 834 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:10:48.895899 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:10:48.909194 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:10:48.989379 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:48.996054 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:49.012834 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:49.031994 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Pushing event deleted for resources: {'Network': ['ID=132a5a94-c14e-4969-994e-837fe8b01394,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:49.035169 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:49.046729 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] 10.222.0.25 "DELETE /v2.0/networks/132a5a94-c14e-4969-994e-837fe8b01394 HTTP/1.1" status: 204 len: 168 time: 1.0859451 May 25 16:10:49.336914 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 48272) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:49.418352 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 48280) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:10:49.424422 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-199f8914-9dde-405a-bc74-89968084556a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0b066f0c91e94675a5051ab935c145f5&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0860806 May 25 16:10:49.482212 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:49.509097 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:49.565225 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:49.569221 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f137e859-8d69-48da-939c-47e0dc435244 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:10:49.595591 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:10:49.595591 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/97ee5f13-a655-4bdd-88d0-3c054007e484 HTTP/1.1" status: 204 len: 168 time: 0.1751461 May 25 16:10:49.597436 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97ee5f13-a655-4bdd-88d0-3c054007e484,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:10:49.602163 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:10:50.513908 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 20644580-7d23-420c-865a-3231c7bc8205 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:10:50.559175 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 20644580-7d23-420c-865a-3231c7bc8205 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:10:50.559863 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 20644580-7d23-420c-865a-3231c7bc8205 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:10:59.248380 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8fd3ab70-caa1-4bdb-9222-108d5a706775 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:01.623085 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:01.758247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-12fee9dd-21a7-4b3e-93b9-d10418504fa7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:02.834708 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:03.833113 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-bf4436d4-ca57-4497-a0d9-92f2dddfbaad service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0740077 May 25 16:11:03.995501 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-088ea2ce-c4d8-44a3-bb05-25e2623435ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:11:03.996989 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-088ea2ce-c4d8-44a3-bb05-25e2623435ed service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 1099 time: 0.0738096 May 25 16:11:04.140514 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-44a3a37f-ed7e-402e-be8c-eade315cedfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:11:04.141976 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-44a3a37f-ed7e-402e-be8c-eade315cedfb service neutron] 10.222.0.74 "GET /v2.0/networks?id=956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 200 len: 916 time: 0.1261373 May 25 16:11:04.214667 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-fcb1d265-328c-44c8-8d85-52721d98bfde service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 200 len: 217 time: 0.0649390 May 25 16:11:04.376627 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-87a8f3d7-351d-4ba0-b64b-2aa6f4fb5f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:11:04.378051 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-87a8f3d7-351d-4ba0-b64b-2aa6f4fb5f73 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 200 len: 855 time: 0.1550965 May 25 16:11:04.425999 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:11:04.426640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-d827a554-eb5e-4f0a-89d3-e524d1809f8b service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=956d5f61-ae8e-4c95-bd97-6ae439ceff67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0411899 May 25 16:11:04.547075 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:04.563394 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-19270c32-a8bc-46f9-87f0-705b2b27f23d service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304109 May 25 16:11:04.702232 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2a978896-3f26-4832-a5bc-f32dc7672c45 req-75fd0379-bdc1-4028-9a48-d208954f4a1d service neutron] 10.222.0.74 "GET /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1308393 May 25 16:11:06.131988 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:29.253305 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4da7097f-57a4-49f9-b907-923b5ec822c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:31.609572 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:31.762676 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-75ee38ff-f673-4251-911a-8990fe5f1428 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:32.844024 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:34.551513 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:36.183435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:41.425759 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:11:46.799759 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c40cd65-9ce4-4db6-83d2-c2292cfe7296 req-85396cb4-b6ba-4a50-baea-1cb020e84db1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:11:46.800564 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c40cd65-9ce4-4db6-83d2-c2292cfe7296 req-85396cb4-b6ba-4a50-baea-1cb020e84db1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Synchronizing usage tracker for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:11:46.818718 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-5c40cd65-9ce4-4db6-83d2-c2292cfe7296 req-85396cb4-b6ba-4a50-baea-1cb020e84db1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Unset dirty status for tenant:fe662b5dcc2c4a1da1aa9473bd7e9dd7 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:11:46.820215 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c40cd65-9ce4-4db6-83d2-c2292cfe7296 req-85396cb4-b6ba-4a50-baea-1cb020e84db1 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 946 time: 0.1312020 May 25 16:11:46.872362 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5c40cd65-9ce4-4db6-83d2-c2292cfe7296 req-465998d3-5beb-43dc-81c8-44a6020c2abc tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/security-groups?id=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451837 May 25 16:11:47.288452 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d177790-a082-4913-a218-557ee93f7158 req-68c78b8d-1a0c-40c2-b338-d748fbc7b1f9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:11:47.291464 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5d177790-a082-4913-a218-557ee93f7158 req-68c78b8d-1a0c-40c2-b338-d748fbc7b1f9 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 946 time: 0.1103201 May 25 16:11:47.517190 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Deleting port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:11:47.517571 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:47.660237 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] For port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,segment=NetworkSegment(6bca21b3-aa16-450a-a9ae-5cdc39f91476),segment_id=6bca21b3-aa16-450a-a9ae-5cdc39f91476)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:11:47.660597 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:47.796337 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Calling delete_port for 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:11:47.913569 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:47.922382 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-987c37cd-f4d9-4c6c-a4b7-e8f6fe444319 tempest-ServerRescueNegativeTestJSON-1492216203 tempest-ServerRescueNegativeTestJSON-1492216203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:47.954406 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['0412da35-fecb-4a70-b77f-dbb7dc9fcd61'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:11:47.972443 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Pushing event deleted for resources: {'Port': ['ID=0412da35-fecb-4a70-b77f-dbb7dc9fcd61,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:48.015008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.015379 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.015779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.016143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.016510 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.016871 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.017227 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.017582 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.017932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.018285 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.018638 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.018988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:48.027247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:48.103534 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-698f703f-fd16-4037-90b1-9cf0b893f09e req-79d2c512-852d-49af-b9f0-829085a2be6d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.25 "GET /v2.0/ports?device_id=2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf HTTP/1.1" status: 200 len: 210 time: 0.0903139 May 25 16:11:48.104598 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] No DVR routers for this DVR port 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:11:48.107094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:48.109816 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'name': 'network-vif-deleted', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:11:48.133037 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5d177790-a082-4913-a218-557ee93f7158 req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] 10.222.0.74 "DELETE /v2.0/ports/0412da35-fecb-4a70-b77f-dbb7dc9fcd61 HTTP/1.1" status: 204 len: 173 time: 0.8356624 May 25 16:11:48.342825 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2a44c5cd-37bd-47dc-b28d-bcaacc2b7faf', 'name': 'network-vif-deleted', 'tag': '0412da35-fecb-4a70-b77f-dbb7dc9fcd61', 'status': 'completed', 'code': 200} May 25 16:11:49.216349 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 49154) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:49.485006 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Deleting subnet bf87cdb0-06e4-4ee0-ad97-e62e40212515 {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:11:49.488641 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:49.542772 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:49.642098 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:49.979245 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:49.983860 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f7424dcc-6a15-41d9-8471-5235d4d04d70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:50.026728 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bf87cdb0-06e4-4ee0-ad97-e62e40212515,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:50.032385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.044402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.044878 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.045296 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.045688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.046078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.046479 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.046872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.047262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.047827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.048249 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.048641 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.049027 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:11:50.053471 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:50.057134 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] 10.222.0.25 "DELETE /v2.0/subnets/bf87cdb0-06e4-4ee0-ad97-e62e40212515 HTTP/1.1" status: 204 len: 168 time: 0.8387504 May 25 16:11:50.059956 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 49172) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:50.105346 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:11:50.168368 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:11:50.168898 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 0412da35-fecb-4a70-b77f-dbb7dc9fcd61 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:11:50.179694 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.319539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.335063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['956d5f61-ae8e-4c95-bd97-6ae439ceff67']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:11:50.349343 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6bca21b3-aa16-450a-a9ae-5cdc39f91476') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:11:50.349634 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6bca21b3-aa16-450a-a9ae-5cdc39f91476') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:11:50.362897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.382111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.390833 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Releasing vlan 836 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:11:50.391301 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:11:50.405695 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:11:50.495590 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.500704 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:50.516168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.529111 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Pushing event deleted for resources: {'Network': ['ID=956d5f61-ae8e-4c95-bd97-6ae439ceff67,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:50.534425 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:50.540391 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-8d4ae0d8-1e79-46de-b76c-d4a81f9def4f admin admin] 10.222.0.25 "DELETE /v2.0/networks/956d5f61-ae8e-4c95-bd97-6ae439ceff67 HTTP/1.1" status: 204 len: 168 time: 0.4789517 May 25 16:11:50.700687 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 49180) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:50.763306 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-678ed1d7-3ffc-42f7-9177-3300e940aa9f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=fe662b5dcc2c4a1da1aa9473bd7e9dd7&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0610120 May 25 16:11:50.766718 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 49186) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:50.845817 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.879620 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.981888 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:50.988338 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d0a9fd2e-1dac-4099-922a-832ab27f3176 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:51.007631 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab057e5d-2c87-45e9-b1a0-7b5ff60a4460,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:51.011226 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:51.023336 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:51.025459 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ab057e5d-2c87-45e9-b1a0-7b5ff60a4460 HTTP/1.1" status: 204 len: 168 time: 0.2572594 May 25 16:11:53.591703 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 49272) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:53.750838 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:53.780007 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:11:53.787353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Usage tracker for resource:security_group_rule and tenant:ef58dd75edd446c2984ec4ef5a4f416c is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:11:53.793432 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:11:53.804682 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:11:53.930100 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:53.935612 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:53.943431 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2d9e00d7-27b0-4588-851e-84712c270338 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:53.989492 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ef58dd75edd446c2984ec4ef5a4f416c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3963699 May 25 16:11:53.990295 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ec1b583-fee9-4fce-ac77-15145037ac23,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:53.992716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 49280) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:53.996079 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:54.063491 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.094023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.163891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.168396 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:54.180586 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ec1b583-fee9-4fce-ac77-15145037ac23,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:54.186279 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:54.189047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.194306 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0ec1b583-fee9-4fce-ac77-15145037ac23 HTTP/1.1" status: 204 len: 168 time: 0.1965325 May 25 16:11:54.620891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 49298) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:54.640772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.657930 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:11:54.665014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Usage tracker for resource:security_group_rule and tenant:8336bcbc332f4c3e9aaf21b1a60dcaa8 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:11:54.670365 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:11:54.681352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:11:54.787311 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.792103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:54.800209 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:54.845106 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8336bcbc332f4c3e9aaf21b1a60dcaa8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2227483 May 25 16:11:54.845929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c674b23-955e-4634-b83d-4be880606063,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:54.848319 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 49302) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:11:54.849848 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:54.962096 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:55.015280 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:55.097816 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:55.101746 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6333b357-51a1-44bc-80d8-9830cd0bff86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:11:55.114654 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c674b23-955e-4634-b83d-4be880606063,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:11:55.119947 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:11:55.124480 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:11:55.125810 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/9c674b23-955e-4634-b83d-4be880606063 HTTP/1.1" status: 204 len: 168 time: 0.2760794 May 25 16:11:59.258395 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9041ea0a-5b9e-4027-9d39-1d8b67d38202 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:01.604456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:01.767360 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d7a0f50d-bd30-4873-a31a-ae30efdd31f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:02.847793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:04.552237 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:06.145289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:18.425132 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:12:29.257167 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4d548b23-06d5-446e-aafa-d69ccd3e6078 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:31.613696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:31.781670 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4248cb10-c21f-49a0-b01b-2a5bd165c2ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:32.851437 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:34.556329 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:36.160461 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:12:55.426263 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:12:59.254844 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-0d73bcf0-9cfe-413c-87b7-828bf8ffe965 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:01.619717 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:01.777749 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-47b0e44c-b1a2-43d9-a283-dc4c6c7a1eae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:02.851483 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:04.560266 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:06.169590 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:29.255540 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9f95d5ef-6b31-46ec-ad34-09ab295c6300 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:31.619938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:31.783997 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9e0b2406-456f-47ca-9cd2-6c3a1301b2da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:32.427920 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:13:32.864085 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:34.575679 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:36.180196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:13:39.072925 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [req-882b486d-29f6-40b7-9526-5cad0e3d442d req-a8815fc2-8a72-4fd7-a6c4-d0ff574f9c13 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] (98391) timed out ('10.222.0.74', 61726) {{(pid=98391) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 16:13:59.248860 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-0b21e23e-8823-47e6-9049-bcfe991e597d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:01.615580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:01.787886 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1f82f062-a520-4a81-9012-3c332117d94d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:02.857794 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:04.577923 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:06.189004 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:09.427763 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:14:29.261494 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-45dc8e76-9243-47ba-8571-0e6dc5cbba90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:31.612602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:31.803073 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-be18c59c-4490-4a84-8915-6db21986e67f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:32.868552 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:34.572874 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:36.184358 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:46.431442 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:14:53.768941 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 51634) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:14:54.014768 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.033487 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:14:54.037969 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Usage tracker for resource:security_group_rule and tenant:47f9703c67814c069c0c5ab775981834 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:14:54.041402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:14:54.048082 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:14:54.157182 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.168426 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.179507 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ec91ad27-9437-4d21-a9b6-1a390a108111 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:14:54.224522 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=47f9703c67814c069c0c5ab775981834&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4543841 May 25 16:14:54.225292 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=552f658a-5fc8-4227-b685-c6dc96a996f1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:14:54.227886 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 51640) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:14:54.234370 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.234764 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.235219 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.235645 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.236040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.236408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.236770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.237132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.237494 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.237873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.238254 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.238630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.243305 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:14:54.317945 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.348417 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.406845 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.411518 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ae5300b3-a03f-4385-baa1-e1edc2e9a3f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:14:54.424114 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=552f658a-5fc8-4227-b685-c6dc96a996f1,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:14:54.436908 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.437570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.437958 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.438317 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.439452 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.439452 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.439824 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.440527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.440527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.440866 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.441218 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.441573 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:14:54.444416 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:14:54.448553 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/552f658a-5fc8-4227-b685-c6dc96a996f1 HTTP/1.1" status: 204 len: 168 time: 0.2147853 May 25 16:14:54.448553 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:14:59.258875 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b64f0dab-3dfc-47c4-abce-9be806239ce6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.060911 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 51798) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:01.192106 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.208355 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:01.212780 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Usage tracker for resource:security_group_rule and tenant:642f853cfee542599d0ec665402d524b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:01.215842 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:01.222094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:01.330470 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.335286 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.344021 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cda9ec0c-b582-4dfc-9369-c9f424094d49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:01.394338 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=642f853cfee542599d0ec665402d524b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3319418 May 25 16:15:01.397251 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 51806) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:01.399512 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2244e625-b2a7-44fa-860b-c111a960e116,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:01.402875 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:01.466698 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.497030 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.564570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.576355 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ceef6d86-7610-4dc9-9dcf-969a195629ec tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:01.603612 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2244e625-b2a7-44fa-860b-c111a960e116,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:01.608231 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:01.617191 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.617468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:01.620363 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2244e625-b2a7-44fa-860b-c111a960e116 HTTP/1.1" status: 204 len: 168 time: 0.2201169 May 25 16:15:01.799484 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5dd27898-5a2c-44e6-a084-6df2a6af789c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.090260 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 51820) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:02.123717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.297448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:02.304959 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Usage tracker for resource:security_group_rule and tenant:9669b2301608450fa0f1b47d3a034c7a is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:02.310434 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:02.321726 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:02.463293 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.468791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.485190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1eae27f8-ac80-4558-a654-4790438acfc5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:02.553129 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9669b2301608450fa0f1b47d3a034c7a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4616661 May 25 16:15:02.557319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 51828) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:02.558487 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7da291fb-984c-4b6d-aa7b-9a3a3d4156c3,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:02.562189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:02.654337 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.723460 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.803211 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.808093 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-00dd3e36-9f30-4ec9-b4c4-208521c1d4d2 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:02.825342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7da291fb-984c-4b6d-aa7b-9a3a3d4156c3,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:02.829670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:02.845805 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:02.856639 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7da291fb-984c-4b6d-aa7b-9a3a3d4156c3 HTTP/1.1" status: 204 len: 168 time: 0.2930732 May 25 16:15:02.887063 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:04.585680 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:06.188824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:23.439703 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:15:29.253497 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2d861586-7efc-4884-8540-9cc620210633 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:31.612330 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:31.801189 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d4aae889-216d-432a-ac04-2c729068e0c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:32.872241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:34.584382 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:36.204772 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:53.809067 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52502) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:54.031316 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.049411 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:54.053933 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Usage tracker for resource:security_group_rule and tenant:ef0a81024c8c48d5ac4bcaa56b031a99 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:54.057855 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:54.065354 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:54.171673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.177032 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.186385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6e62e2c2-9504-4fe5-b580-a3ad1d22f354 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:54.240723 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52520) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:54.244515 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ef0a81024c8c48d5ac4bcaa56b031a99&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4335096 May 25 16:15:54.271531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=351f2d2e-e676-47e5-b94b-17723942674a,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:54.278462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:54.333771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.374940 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.442259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.450500 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:54.464848 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=351f2d2e-e676-47e5-b94b-17723942674a,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:54.474926 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.475683 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.476779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.477419 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.477971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.478528 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.479214 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.479800 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.480348 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.482630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.483230 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.483846 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:54.488142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:54.489939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:54.507438 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/351f2d2e-e676-47e5-b94b-17723942674a HTTP/1.1" status: 204 len: 168 time: 0.2618725 May 25 16:15:55.013041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52540) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:55.032208 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.049776 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:55.054111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Usage tracker for resource:security_group_rule and tenant:ca89d517fc134efb9a92029922bf705e is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:55.058059 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:55.065166 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:55.175698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.184115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.194023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6681ca67-1a8f-4ace-9c08-3abc55df0647 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:55.280154 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ca89d517fc134efb9a92029922bf705e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2656903 May 25 16:15:55.282874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52550) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:55.287108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2f952c4-5644-412a-a7c1-3bf87f12ed1c,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:55.292283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:55.399167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.449511 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.543027 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.550316 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-12889402-7376-441b-adc0-b63c496560fa tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:55.571267 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2f952c4-5644-412a-a7c1-3bf87f12ed1c,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:55.595215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.595856 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.596451 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.597236 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.597808 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.598562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.599365 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.600279 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.600878 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.601531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.602034 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.602618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:15:55.609457 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:55.613017 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:55.619604 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f2f952c4-5644-412a-a7c1-3bf87f12ed1c HTTP/1.1" status: 204 len: 168 time: 0.3348942 May 25 16:15:56.540481 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52612) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:56.752539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:56.783001 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:56.792641 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Usage tracker for resource:security_group_rule and tenant:5f7132f13dd74a37bb8b0bc18f45e258 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:56.804143 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:56.827411 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:57.042663 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.050376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.115321 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2393481d-8de3-4fb4-9d1f-224b48f21659 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:57.137507 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5f7132f13dd74a37bb8b0bc18f45e258&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5958741 May 25 16:15:57.141705 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52638) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:57.187896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50d2b341-bf25-427e-9606-2c86b4513f98,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:57.194579 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:57.312361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.373710 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.471329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.479453 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cc250d43-475e-43b2-8c9d-bd214d800536 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:57.500739 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50d2b341-bf25-427e-9606-2c86b4513f98,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:57.506116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:57.521035 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:57.523671 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-047c7f0d-c7fd-4582-9d63-0a3bc655f212 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/50d2b341-bf25-427e-9606-2c86b4513f98 HTTP/1.1" status: 204 len: 168 time: 0.3805826 May 25 16:15:58.069705 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52670) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:58.104631 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.135252 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:15:58.142606 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Usage tracker for resource:security_group_rule and tenant:f943c2ca495540639af75998e667e5ad is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:15:58.150900 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:15:58.163017 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:15:58.314046 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.321235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.337485 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6fd2f43f-1997-4e24-b79c-972f5a31c69f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:58.411193 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e982890d-8694-40bd-ae82-0f1c6acdc127,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:58.422995 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f943c2ca495540639af75998e667e5ad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3487797 May 25 16:15:58.425754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52682) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:15:58.428708 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:58.530803 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.576149 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.694878 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.700014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9b2103e3-07c6-4f8f-ad85-389af8338820 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:15:58.714551 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e982890d-8694-40bd-ae82-0f1c6acdc127,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:15:58.718542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:15:58.722409 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:15:58.723718 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e982890d-8694-40bd-ae82-0f1c6acdc127 HTTP/1.1" status: 204 len: 168 time: 0.2967951 May 25 16:15:59.267743 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9d017e7e-ae0a-41a5-bcc1-ca790494ba53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:00.283419 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52752) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:00.436479 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:16:00.450515 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:00.478950 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:00.485153 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Usage tracker for resource:security_group_rule and tenant:94a504f9aa98474a955bd0735076a977 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:00.491414 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:00.503164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:00.693752 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:00.700283 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:00.717143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f3945d67-a544-4974-bd87-26b68c6a1dc1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:00.796874 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb9ba7ce-d1d8-4a92-b05a-c2e3190672e4,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:00.802145 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:00.812847 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52772) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:00.813372 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=94a504f9aa98474a955bd0735076a977&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5270603 May 25 16:16:00.902935 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:00.936678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.010407 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.019043 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-276ee0ce-4f9b-4807-a670-d1a6311989ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:01.045421 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb9ba7ce-d1d8-4a92-b05a-c2e3190672e4,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:01.050206 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:01.068576 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.071006 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fb9ba7ce-d1d8-4a92-b05a-c2e3190672e4 HTTP/1.1" status: 204 len: 168 time: 0.2558126 May 25 16:16:01.566828 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52808) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:01.586893 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.602824 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:01.607173 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Usage tracker for resource:security_group_rule and tenant:ffcdcbfd337446c4970fb8c9c5cfcc5b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:01.610962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:01.617757 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:01.630196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.740675 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.747270 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.761441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5b0c27c8-dedd-432e-85fb-37e036db467b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:01.810127 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-defcaf7c-345f-4b58-ba16-5cd18b1c69df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.847159 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ffcdcbfd337446c4970fb8c9c5cfcc5b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2754605 May 25 16:16:01.848183 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52822) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:01.853773 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=051e0724-5292-446d-9848-4e2c4ed50a58,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:01.861187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:01.963720 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:01.998713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.061413 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.065499 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-20231dd5-4607-41cf-8065-fcc10bfd0002 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:02.080562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=051e0724-5292-446d-9848-4e2c4ed50a58,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:02.083913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:02.086347 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.087674 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/051e0724-5292-446d-9848-4e2c4ed50a58 HTTP/1.1" status: 204 len: 168 time: 0.2379944 May 25 16:16:02.167989 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52832) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:02.482536 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.502573 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:02.508164 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Usage tracker for resource:security_group_rule and tenant:df4ca7260c1543b0a86aab86938b738d is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:02.513644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:02.524472 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:02.603849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52840) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:02.623358 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.652902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:02.659458 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Usage tracker for resource:security_group_rule and tenant:ad9403f4a74c47c4b97535098a319ef8 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:02.666149 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:02.670731 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.677792 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.677998 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:02.692876 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-de92cb71-d193-4dd6-aa36-4af00104e8eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:02.773624 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=df4ca7260c1543b0a86aab86938b738d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6015041 May 25 16:16:02.773624 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2bcfe76-b60c-4cad-813c-ed8db2055b05,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:02.777385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52844) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:02.797655 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:02.816328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.821490 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.829798 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:02.866196 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.880891 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ad9403f4a74c47c4b97535098a319ef8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2758162 May 25 16:16:02.881698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52852) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:02.885229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10b92db5-e6b0-493c-9e15-35f38f1cdb80,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:02.900006 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.900293 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:02.918298 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.965088 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.970707 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:02.971810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2a79426b-ac86-4fa7-876f-3bd65adac110 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:02.988692 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2bcfe76-b60c-4cad-813c-ed8db2055b05,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:02.994166 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:02.998673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:03.000065 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e2bcfe76-b60c-4cad-813c-ed8db2055b05 HTTP/1.1" status: 204 len: 168 time: 0.2213085 May 25 16:16:03.031112 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:03.140802 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:03.156064 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3ff46de0-0919-4509-a3a4-c177b42774e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:03.189398 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10b92db5-e6b0-493c-9e15-35f38f1cdb80,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:03.203689 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:03.206584 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:03.224210 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/10b92db5-e6b0-493c-9e15-35f38f1cdb80 HTTP/1.1" status: 204 len: 168 time: 0.3350112 May 25 16:16:03.803250 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 52882) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:03.864303 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:03.899808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:03.904548 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Usage tracker for resource:security_group_rule and tenant:32bec7a8607f4a109d696cfd9ef819aa is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:03.908261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:03.915769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:04.071746 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.082662 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.127062 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-81b0b71f-f5e5-4dd7-af8c-c38b446dc3a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:04.209512 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d16ed10-052e-4eeb-8833-c961a4f25c09,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:04.228288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:04.289142 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=32bec7a8607f4a109d696cfd9ef819aa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4831820 May 25 16:16:04.293563 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 52902) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:04.419829 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.476578 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.614374 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.629506 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.642667 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b5876648-65d7-4856-b788-a7fb22373dac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:04.660324 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d16ed10-052e-4eeb-8833-c961a4f25c09,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:04.663641 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:04.666235 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:04.667375 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8d16ed10-052e-4eeb-8833-c961a4f25c09 HTTP/1.1" status: 204 len: 168 time: 0.3706276 May 25 16:16:06.240367 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.418404 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53024) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:07.422229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53026) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:07.566724 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.576095 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.583993 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:07.589117 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Usage tracker for resource:security_group_rule and tenant:b9226e10e9b04e5e9c824e16044ed819 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:07.592566 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:07.596977 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:07.599605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:07.602420 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Usage tracker for resource:security_group_rule and tenant:43873269ecaf4358b5d50c32dfb84da0 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:07.606147 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:07.613690 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:07.702533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.711422 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.722630 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.724540 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:07.731022 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.762536 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0eacefdb-d8b3-40d6-a88c-ce7f2c1d0574 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:07.765678 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ff66aca-991d-4ff0-a143-3f73eb289d43,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:07.772353 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:07.785732 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b9226e10e9b04e5e9c824e16044ed819&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3623192 May 25 16:16:07.787065 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53048) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:07.841873 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=43873269ecaf4358b5d50c32dfb84da0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4211588 May 25 16:16:07.844289 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6105d822-6840-4f50-80dd-6064b8d647c7,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:07.847015 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53052) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:07.852620 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d7138cc1-948e-43a2-bab3-bc791f825ee7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:07.871008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.906609 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.945420 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.972985 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.975881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:07.979375 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4469db58-0673-43cb-8f2d-769fb8dcbb87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:07.997126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ff66aca-991d-4ff0-a143-3f73eb289d43,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:08.010290 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:08.020272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.022554 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ef502b67-6673-4803-8e64-84d48779c96e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2ff66aca-991d-4ff0-a143-3f73eb289d43 HTTP/1.1" status: 204 len: 168 time: 0.2340102 May 25 16:16:08.061244 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.074249 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-28ee012c-be23-42c3-80d7-1a92f5cefd3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:08.102378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6105d822-6840-4f50-80dd-6064b8d647c7,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:08.114059 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.116409 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6105d822-6840-4f50-80dd-6064b8d647c7 HTTP/1.1" status: 204 len: 168 time: 0.2681541 May 25 16:16:08.128966 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:08.565799 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53076) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:08.600817 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.629683 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:08.637505 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Usage tracker for resource:security_group_rule and tenant:9a7f66a6e3d14da485e4ad5b3342c81f is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:08.652493 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:08.662950 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:08.778655 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.784007 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.794297 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b221be95-cf19-4d89-a233-71194d4f7eb5 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:08.842243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cd59d8e-8794-4f80-adbe-1cb44f3e95be,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:08.846294 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:08.849383 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6561b19e-ab11-4c08-8358-9f1ee8a19893 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9a7f66a6e3d14da485e4ad5b3342c81f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2809498 May 25 16:16:08.854398 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53088) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:08.934351 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:08.985058 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:09.095134 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:09.119191 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ea9621da-e51a-468e-bdbe-bc5ee3a1ec73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:09.156736 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cd59d8e-8794-4f80-adbe-1cb44f3e95be,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:09.160340 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:09.163387 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:09.166010 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4cd59d8e-8794-4f80-adbe-1cb44f3e95be HTTP/1.1" status: 204 len: 168 time: 0.3106050 May 25 16:16:28.424656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53478) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:28.489361 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53486) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:28.664489 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.675087 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.697402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:28.700472 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:28.705513 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Usage tracker for resource:security_group_rule and tenant:57dc530d258a4ac293e32f545053953b is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:28.708958 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Usage tracker for resource:security_group_rule and tenant:263ffacef37649428951ffb3ac45cc66 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:28.712451 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:28.715735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:28.724616 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:28.727331 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:28.896047 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.898909 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.903771 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.913064 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e3e27e0d-558d-4347-8c46-6dbd97b71c7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:28.923743 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:28.985280 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=263ffacef37649428951ffb3ac45cc66&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5593812 May 25 16:16:28.988250 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=57dc530d258a4ac293e32f545053953b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4978473 May 25 16:16:28.990092 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53510) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:28.991364 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0abe810c-8e6e-4a25-a3f8-a3e813afa1f6,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:28.994936 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53512) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:28.998222 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:28.998982 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b33432fb-9d34-433b-8368-1fc72d792fed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.063s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:29.136773 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62dd1ca3-254c-4cef-9867-b472d6000692,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:29.144822 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-97922356-3d90-4834-b319-9c383c37c9f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:29.150880 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.161358 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.230520 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.238827 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.298117 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1b6383b9-0b49-4ac6-b879-acb7a858ca56 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.350320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.363537 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.366185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5f98b5bb-16c4-45cc-8fd2-a4c0f9a979db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:29.374484 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a64-3278-4c56-b3e8-b99dcc1356d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:29.402000 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0abe810c-8e6e-4a25-a3f8-a3e813afa1f6,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:29.404051 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62dd1ca3-254c-4cef-9867-b472d6000692,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:29.407475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.412171 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0abe810c-8e6e-4a25-a3f8-a3e813afa1f6 HTTP/1.1" status: 204 len: 168 time: 0.4195664 May 25 16:16:29.414471 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:29.434615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:29.480368 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.486498 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-08ecf2de-4195-4bab-a236-1434cfcbde3c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/62dd1ca3-254c-4cef-9867-b472d6000692 HTTP/1.1" status: 204 len: 168 time: 0.4883392 May 25 16:16:29.913792 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53544) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:29.940844 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:29.964097 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:29.971344 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53548) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:29.972614 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Usage tracker for resource:security_group_rule and tenant:3d23ce6df0304e82936dd0bdaa4bb2f7 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:29.978152 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:29.988261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:29.992510 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.009101 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:30.014239 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Usage tracker for resource:security_group_rule and tenant:00910e8d6fde4f8b9edeead9ac6d5c85 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:30.018264 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:30.027294 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:30.101264 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.107260 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.124799 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cf866a-e2db-4c52-b3de-dc75c3c59367 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:30.152189 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.158056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.169879 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c609e4cf-107a-41c5-9fb5-35a352e96973 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:30.182614 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3d23ce6df0304e82936dd0bdaa4bb2f7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2671804 May 25 16:16:30.183894 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2f9f305-73f2-46a9-979e-eb91d183f3a7,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:30.187003 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53552) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:30.187273 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f754a885-6e53-4d3e-82d7-e2b7e7414f99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:30.306139 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92f2e1fc-f4f5-4428-9e16-0953106b070f,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:30.318981 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=00910e8d6fde4f8b9edeead9ac6d5c85&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3460894 May 25 16:16:30.321907 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53556) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:30.332555 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:30.381018 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.419437 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.434505 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.459067 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.533937 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.553103 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.553927 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-92d189cf-9117-475c-890f-589922ea24fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:30.569341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7331ce26-b12e-4cc3-a995-763642521a94 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:30.587386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2f9f305-73f2-46a9-979e-eb91d183f3a7,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:30.596977 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92f2e1fc-f4f5-4428-9e16-0953106b070f,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:30.603159 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:30.611915 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:30.619718 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.627463 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/92f2e1fc-f4f5-4428-9e16-0953106b070f HTTP/1.1" status: 204 len: 168 time: 0.3007390 May 25 16:16:30.656514 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:30.663303 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e2f9f305-73f2-46a9-979e-eb91d183f3a7 HTTP/1.1" status: 204 len: 168 time: 0.4744747 May 25 16:16:31.510228 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53600) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:31.530680 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.548644 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:31.553185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Usage tracker for resource:security_group_rule and tenant:a33352301bf546b3a59c7931dc633d52 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:31.557150 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:31.564738 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:31.671172 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.748855 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.754953 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.769492 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7843fa04-b46a-4d4a-985c-74995ae77a26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:31.810660 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-270ea138-72af-4011-886c-0911aef567c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.818225 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a33352301bf546b3a59c7931dc633d52&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3068771 May 25 16:16:31.821193 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53608) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:31.825089 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=046f9576-2aa8-45a1-83c0-89098520b2db,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:31.838995 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:31.900610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:31.943042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:32.033950 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:32.043536 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-672a35c6-e1da-46a3-9983-7f9cac44d8cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:32.067226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=046f9576-2aa8-45a1-83c0-89098520b2db,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:32.071479 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:32.073441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:32.075666 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/046f9576-2aa8-45a1-83c0-89098520b2db HTTP/1.1" status: 204 len: 168 time: 0.2530639 May 25 16:16:32.878091 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:33.830062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 53708) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:33.965138 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:33.981008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:33.985126 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Usage tracker for resource:security_group_rule and tenant:51b3de2580f644d08157d7ec6927eb8a is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:33.988140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:33.995201 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:34.088280 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.092575 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.099980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6e832417-b30a-4bd8-935d-bd929fe27727 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:34.154414 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=51b3de2580f644d08157d7ec6927eb8a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3229456 May 25 16:16:34.156025 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67a84333-f085-4845-a875-3d83ca06b880,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:34.157764 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53714) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:34.160715 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:34.237542 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.266466 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.337405 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.342809 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-8d714ca5-bbbc-46a0-b2e3-b643b907a7a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:34.354277 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67a84333-f085-4845-a875-3d83ca06b880,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:34.358184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:34.361813 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:34.363256 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/67a84333-f085-4845-a875-3d83ca06b880 HTTP/1.1" status: 204 len: 168 time: 0.2037935 May 25 16:16:34.599407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:36.248289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:36.344944 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53786) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:36.752043 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Deleting subnet 8359c6d8-0d8a-4f13-a065-36bfd3350e4a {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:16:36.756101 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:36.813297 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:36.962635 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.375048 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.379637 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:37.415516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8359c6d8-0d8a-4f13-a065-36bfd3350e4a,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:37.418924 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:37.419945 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.426584 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a7aae4f7-08f6-4454-bb72-ffd97249237f admin admin] 10.222.0.25 "DELETE /v2.0/subnets/8359c6d8-0d8a-4f13-a065-36bfd3350e4a HTTP/1.1" status: 204 len: 168 time: 1.0801356 May 25 16:16:37.430361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53808) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:37.431049 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:16:37.544994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.682671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.701980 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:16:37.717298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01e89f68-a28a-4109-a6b7-004659c4f358') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:16:37.717721 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01e89f68-a28a-4109-a6b7-004659c4f358') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:16:37.733870 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.768857 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.778463 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Releasing vlan 837 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:16:37.778834 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:16:37.792786 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:16:37.902935 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.911844 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:37.927685 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d6cfe945-8cb5-453b-be79-b76c3687e228 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:37.958946 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Pushing event deleted for resources: {'Network': ['ID=bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:37.962271 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] 10.222.0.25 "DELETE /v2.0/networks/bfef2ef6-fea5-4e0c-a9a2-c3f35932acfd HTTP/1.1" status: 204 len: 168 time: 0.5307775 May 25 16:16:37.963201 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-15b9b1c6-b942-4645-882f-b07755d24f6e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:38.099707 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53822) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:38.173899 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-01463654-865c-4475-a482-8e60fb896274 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ac7ba677968248629edb2c52ffcbaf6b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0693130 May 25 16:16:38.174258 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 53828) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:38.247822 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:38.276744 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:38.338239 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:38.342415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e0071f66-e193-4c6b-9a57-5c598bc26b61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:38.357883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76fee170-46c4-4984-b18d-a602291af03e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:38.360983 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:38.378415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:38.380449 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/76fee170-46c4-4984-b18d-a602291af03e HTTP/1.1" status: 204 len: 168 time: 0.2048790 May 25 16:16:48.419505 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54018) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:48.617188 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:48.632524 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:48.637601 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Usage tracker for resource:security_group_rule and tenant:9b48cb0330604d5fa43ee83867e196d5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:48.642623 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:48.657078 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:48.732600 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54034) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:48.803385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:48.810421 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:48.826186 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-310e4966-951e-480e-ba30-0ca57e2d29a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:48.881438 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9b48cb0330604d5fa43ee83867e196d5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4595690 May 25 16:16:48.884441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54042) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:48.898854 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:48.916727 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=762f2b04-f4ca-454f-be4f-254b12ecd723,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:48.922050 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:48.922246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:48.935696 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Usage tracker for resource:security_group_rule and tenant:7e07bd8974134e8e9d584e3691cbb3a4 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:48.942187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:48.955308 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:49.010642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.054132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.156019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.161157 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.172491 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ccfa34de-00a8-41f9-8c0b-52a8931e2ead admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:49.185615 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.237825 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7e07bd8974134e8e9d584e3691cbb3a4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5037820 May 25 16:16:49.241170 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=059d320c-e6e1-4cc1-917f-4ae60345c567,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:49.241954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54046) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:49.244692 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.246092 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/762f2b04-f4ca-454f-be4f-254b12ecd723 HTTP/1.1" status: 204 len: 168 time: 0.3603377 May 25 16:16:49.247075 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:49.247622 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-cfc98ab4-de39-4b00-8c24-0caab51cce96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.053s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:49.270796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=762f2b04-f4ca-454f-be4f-254b12ecd723,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:49.274358 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:49.362164 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.399911 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.473872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.478605 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-70dd1d41-0217-4502-9b34-c78fa8f4958a tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:49.494115 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=059d320c-e6e1-4cc1-917f-4ae60345c567,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:49.496600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:49.509807 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:49.510951 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-80f2290a-5601-4e9e-9249-3c1c30b40cc9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/059d320c-e6e1-4cc1-917f-4ae60345c567 HTTP/1.1" status: 204 len: 168 time: 0.2669432 May 25 16:16:50.060606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54074) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:50.097142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.126213 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:50.137218 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Usage tracker for resource:security_group_rule and tenant:fa97594e6e45403a977556009744d400 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:50.141549 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:50.151306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:50.312890 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.318967 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.336086 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c5dc0fda-32e8-4a5d-8d66-99b3f00f7612 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:50.413298 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=fa97594e6e45403a977556009744d400&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3511920 May 25 16:16:50.415319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39ea9d4e-6799-4c08-893c-5102c636c331,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:50.416502 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54086) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:50.418901 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:50.471883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54094) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:50.490380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.518430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.583303 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.589789 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-205ffaf9-a5ec-4885-8cf9-8e44d5e465d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:50.604766 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39ea9d4e-6799-4c08-893c-5102c636c331,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:50.607278 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.607538 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:50.608888 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.613174 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/39ea9d4e-6799-4c08-893c-5102c636c331 HTTP/1.1" status: 204 len: 168 time: 0.1955574 May 25 16:16:50.639114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:50.644992 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Usage tracker for resource:security_group_rule and tenant:71f7645c83b94f3d933b445a98612dd0 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:50.650328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:50.670043 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:50.791403 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.798592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:50.812415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ac498028-ce26-48e4-870f-d75db4991b8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:50.858939 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=71f7645c83b94f3d933b445a98612dd0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3855462 May 25 16:16:50.861050 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1abe11df-54f4-48a0-8cb7-1f21f9918af4,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:50.862112 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54108) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:50.864433 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-19574b0a-8c0c-48ea-b3b4-af4b3cd07b27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:50.954964 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:51.121012 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:51.227840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:51.237682 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cc668e8-342e-4694-b92d-3ac00fdaab00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:51.268576 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1abe11df-54f4-48a0-8cb7-1f21f9918af4,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:51.273586 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:51.275325 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:51.277515 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b92a3b0e-003e-4787-bb5b-0d55a7b2cf64 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1abe11df-54f4-48a0-8cb7-1f21f9918af4 HTTP/1.1" status: 204 len: 168 time: 0.4139473 May 25 16:16:55.457747 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54254) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:55.612070 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.635369 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:55.639694 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Usage tracker for resource:security_group_rule and tenant:80de656e272c4077aa29f804eeebc9c5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:55.643188 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:55.650845 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:55.754881 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.759475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.767989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c383829b-05dd-4074-985f-7ce30574694a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:55.816473 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54268) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:55.817086 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=80de656e272c4077aa29f804eeebc9c5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3573258 May 25 16:16:55.821607 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd86166d-99e4-40ff-aafc-974090b140d3,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:55.835434 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.836423 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.836806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.837175 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.837534 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.837894 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.838291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.838648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.839316 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.839316 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.839762 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.840111 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:55.844404 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:55.889391 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.919417 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.981902 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:55.987714 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cde535ac-831a-47ee-8c68-472cf76eec58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:55.999444 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd86166d-99e4-40ff-aafc-974090b140d3,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:56.012008 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.012725 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.013288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.013527 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.013913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.014287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.014669 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.015047 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.015438 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.015827 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.016181 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.016534 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:16:56.019538 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:56.020680 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fd86166d-99e4-40ff-aafc-974090b140d3 HTTP/1.1" status: 204 len: 168 time: 0.2023399 May 25 16:16:56.022051 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:57.232277 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54290) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:57.377816 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.407766 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:57.415069 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Usage tracker for resource:security_group_rule and tenant:ba01124354b341a4948b7d700d888f5b is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:57.420173 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:57.430981 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:57.547230 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.552381 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.560330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07ee1a63-2c3e-4d6f-8797-db7cedc1fabd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:57.610649 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ba01124354b341a4948b7d700d888f5b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3772113 May 25 16:16:57.611688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=215c4e19-fdd3-491b-839a-ed5e3178baea,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:57.614806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54304) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:57.617639 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-afe4344c-3f29-4855-b774-322bbbba4f3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:57.683659 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.714671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.775384 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.782626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9cb754d2-952d-4d35-b0b3-883d6c10b53c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:57.804467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=215c4e19-fdd3-491b-839a-ed5e3178baea,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:57.807431 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:57.834838 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:57.840140 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7373c9d9-d79f-4f0d-8167-cc5582a0f8ec admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/215c4e19-fdd3-491b-839a-ed5e3178baea HTTP/1.1" status: 204 len: 168 time: 0.2239838 May 25 16:16:58.304647 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54336) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:58.326047 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.341664 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:16:58.349143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Usage tracker for resource:security_group_rule and tenant:2580d5a8569641c5acb4a8ee4c51a6bf is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:16:58.352286 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:16:58.358550 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:16:58.457451 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.462649 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.474089 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7d830136-77ea-45d5-b86a-0eaeed361218 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:58.520495 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2580d5a8569641c5acb4a8ee4c51a6bf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2138042 May 25 16:16:58.521517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27e64017-3fd1-47d5-a891-5362c118214c,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:58.523893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54342) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:16:58.525737 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:58.602042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.652670 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.742448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.747007 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-456fc653-23c3-40c2-81e1-d72198d5ea1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:16:58.760344 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27e64017-3fd1-47d5-a891-5362c118214c,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:16:58.765874 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:16:58.769921 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:16:58.776112 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/27e64017-3fd1-47d5-a891-5362c118214c HTTP/1.1" status: 204 len: 168 time: 0.2445600 May 25 16:16:59.276216 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-141432a4-d027-4f50-8957-0651ef228000 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:01.617613 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:01.837969 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b90c0586-3aca-4a9e-8a62-77b763ed81a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:02.876846 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:04.595486 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:06.269438 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.251498 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54620) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:13.445651 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.464361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:13.471439 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Usage tracker for resource:security_group_rule and tenant:5cfce9744c504901b2020a461643ecee is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:13.476845 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:13.487688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:13.602826 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.609611 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.619642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-01320cd8-a99b-4444-afa9-54bef682c0eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:13.691531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54628) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:13.703915 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5cfce9744c504901b2020a461643ecee&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4497545 May 25 16:17:13.705795 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b991d0b-cb29-43ec-82f6-eceac134e5f5,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:13.713229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:13.807810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.853969 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.940304 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:13.946673 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-0268a8cf-e32e-4619-bf97-3f50939c9743 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:13.971270 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b991d0b-cb29-43ec-82f6-eceac134e5f5,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:13.980657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:13.998588 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:14.006154 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3b991d0b-cb29-43ec-82f6-eceac134e5f5 HTTP/1.1" status: 204 len: 168 time: 0.3124287 May 25 16:17:14.431199 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:17:14.467258 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54642) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:14.499115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:14.526930 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:14.534455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Usage tracker for resource:security_group_rule and tenant:085f5a6aa1c844b0b1751f0acaa55656 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:14.539980 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:14.550115 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:14.737903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:14.743823 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:14.760288 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-56d7a90a-b15d-44a2-ba4e-f6bc7bd5d5c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:14.840804 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=085f5a6aa1c844b0b1751f0acaa55656&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3712678 May 25 16:17:14.842490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54646) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:14.843895 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed2d1898-4572-4e7b-a47a-ed93d4137b1c,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:14.850344 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:14.921085 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:14.952190 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:15.008485 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:15.012717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b6e737c2-7e82-4e2e-b3d6-a381e237e381 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:15.024956 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed2d1898-4572-4e7b-a47a-ed93d4137b1c,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:15.028895 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:15.032970 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:15.034111 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ed2d1898-4572-4e7b-a47a-ed93d4137b1c HTTP/1.1" status: 204 len: 168 time: 0.1902497 May 25 16:17:29.261219 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-60184d5b-7492-42d2-a7e0-72740341a018 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:29.745251 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54860) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:29.884560 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:29.900316 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:29.904505 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Usage tracker for resource:security_group_rule and tenant:022aea61f77f4a1abd6a31edeef99035 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:29.907517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:29.913769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:30.010403 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.016344 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.024038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-8affd157-6087-4fa6-b555-3c95981c15b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:30.073990 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=022aea61f77f4a1abd6a31edeef99035&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3267300 May 25 16:17:30.074647 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7029e426-db2b-440b-9020-e71edc3f03f1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:30.077430 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54868) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:30.078811 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b7988478-dc0c-461a-b06e-abbdb6918368 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:30.151379 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.182182 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.253515 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.260698 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-3a3cbdac-b5df-4054-959d-b30071ba92f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:30.275214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7029e426-db2b-440b-9020-e71edc3f03f1,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:30.278461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:30.280642 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:30.281776 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-4329a7b0-0adf-4177-a9af-ab3d9bebcf37 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7029e426-db2b-440b-9020-e71edc3f03f1 HTTP/1.1" status: 204 len: 168 time: 0.2030201 May 25 16:17:31.624064 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:31.639072 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54914) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:31.821782 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-156081aa-a586-4053-9ca3-d5b429f1cee4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:31.827127 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:31.856826 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:31.863402 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Usage tracker for resource:security_group_rule and tenant:8ef6d122d5cc49d7a375e8cf721b48a5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:31.867881 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:31.878788 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:31.972805 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:31.978830 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:31.986678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c6c5a17c-cef0-4ae1-9c56-82993805cb44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:32.028143 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c00d109c-0cce-44ad-8e68-162ce05868c8,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:32.031230 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:32.033985 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-fb46af6a-7231-4a00-9209-6b5f2440201d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8ef6d122d5cc49d7a375e8cf721b48a5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3930554 May 25 16:17:32.038048 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54924) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:32.125152 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.157731 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.225539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.232193 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e12905fb-da0d-4ba4-8028-5eabcf294994 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:32.249791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c00d109c-0cce-44ad-8e68-162ce05868c8,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:32.252678 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:32.260297 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.261714 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c00d109c-0cce-44ad-8e68-162ce05868c8 HTTP/1.1" status: 204 len: 168 time: 0.2217588 May 25 16:17:32.652891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 54938) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:32.676378 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.696522 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:32.702427 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Usage tracker for resource:security_group_rule and tenant:407d2d05a5754234b02808886c40e503 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:32.706264 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:32.715012 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:32.820355 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.826757 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.840759 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26810d8e-93ca-479a-aa2a-bfb9d6aa6269 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:32.889902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=416ef816-0e78-47ea-844c-834c977ad654,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:32.893759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:32.898601 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=407d2d05a5754234b02808886c40e503&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2444136 May 25 16:17:32.899092 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 54944) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:32.899895 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-34b93a15-9832-4945-99e7-4d3cdd243f18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:33.015315 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:33.063741 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:33.139489 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:33.144068 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e82f4268-fb84-4918-a2ca-bde9a397f1ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:33.157495 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=416ef816-0e78-47ea-844c-834c977ad654,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:33.167892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:33.168756 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:33.169962 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-34a92656-3618-437b-97f3-43f1d0560b24 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/416ef816-0e78-47ea-844c-834c977ad654 HTTP/1.1" status: 204 len: 168 time: 0.2682118 May 25 16:17:34.592680 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:34.735544 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55000) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:35.125702 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.154337 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:35.161533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Usage tracker for resource:security_group_rule and tenant:78c75db8cce34f27969ff1eeb969f5af is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:35.167269 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:35.178406 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:35.336556 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.343282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.358565 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6c2e5934-0e62-4bb0-b51b-f0803d0d56a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:35.404065 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=78c75db8cce34f27969ff1eeb969f5af&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6673658 May 25 16:17:35.408737 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55024) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:35.415627 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce577e71-d550-4542-ad5d-dee788145c4c,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:35.478896 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b1d84f63-efed-47bb-a585-d2573a7f43f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:35.521583 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.574011 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.650194 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.660955 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-63431350-99a3-42ad-923a-80b6990fcd20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:35.675817 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce577e71-d550-4542-ad5d-dee788145c4c,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:35.680914 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:35.707366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:35.709024 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ce577e71-d550-4542-ad5d-dee788145c4c HTTP/1.1" status: 204 len: 168 time: 0.2979343 May 25 16:17:36.268819 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.313373 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55174) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:44.446957 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.467037 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:44.472042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Usage tracker for resource:security_group_rule and tenant:b2dda489dec64ff9a6797ec136240f30 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:44.475187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:44.482002 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:44.606250 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.610653 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.617755 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f77a58ca-4ef3-4120-ba61-5b31c1957423 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:44.670465 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b59f93a4-3ff6-44e4-a8af-82bef195ec04,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:44.675197 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b2dda489dec64ff9a6797ec136240f30&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3603609 May 25 16:17:44.676259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7e1ed6a6-a7f6-4138-bac3-66ed935c92e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:44.679863 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55186) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:44.755030 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.785262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.856262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.862252 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6a541298-d193-4bf2-b86d-fd17f73865e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:44.885966 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b59f93a4-3ff6-44e4-a8af-82bef195ec04,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:44.893655 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:44.899284 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b59f93a4-3ff6-44e4-a8af-82bef195ec04 HTTP/1.1" status: 204 len: 168 time: 0.2141418 May 25 16:17:44.899284 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f303f523-5d68-489f-aed7-f0361f5f8cf5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:45.448731 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55208) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:45.480562 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.506892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:45.512717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Usage tracker for resource:security_group_rule and tenant:80f4b873058b4227bb0319bf0edc0830 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:45.518488 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:45.529425 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:45.682781 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.689984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.715416 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-79e4b271-2884-41be-82c4-2242a6355364 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:45.753543 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c020c3a7-f87a-4483-8cf0-2fa459ece3f2,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:45.757762 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:45.760431 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=80f4b873058b4227bb0319bf0edc0830&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3104830 May 25 16:17:45.765809 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55220) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:45.796544 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55224) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:45.862948 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.893986 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.978448 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.982275 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:45.986762 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3bf3a593-e3cc-48c6-8e80-ce4a4f1901a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:46.008502 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c020c3a7-f87a-4483-8cf0-2fa459ece3f2,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:46.010285 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:46.016307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Usage tracker for resource:security_group_rule and tenant:a7a801ced04646a6b80b686efbb67643 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:46.020017 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:46.027147 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:46.034255 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:46.050504 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.052576 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d99bbaf5-4466-40cd-9248-486bb40a54c7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c020c3a7-f87a-4483-8cf0-2fa459ece3f2 HTTP/1.1" status: 204 len: 168 time: 0.2844005 May 25 16:17:46.137835 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.147507 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.165241 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cc9aa26b-6486-4341-b2c4-86b594ddaa7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:46.233689 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a7a801ced04646a6b80b686efbb67643&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4323101 May 25 16:17:46.234300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55238) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:46.243849 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdf82b68-dd40-41de-be99-6f5fc339f646,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:46.249817 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cf1a9c09-d5e0-457e-ad33-580910f7ce97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:46.355246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.398497 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.477556 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.482329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-52fcaa76-5d71-425c-ada3-7178b1f2c99e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:46.496104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdf82b68-dd40-41de-be99-6f5fc339f646,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:46.500752 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:46.504742 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:46.506073 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/bdf82b68-dd40-41de-be99-6f5fc339f646 HTTP/1.1" status: 204 len: 168 time: 0.2699959 May 25 16:17:51.430998 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:17:52.286541 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55370) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:52.428976 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.445983 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:52.450597 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Usage tracker for resource:security_group_rule and tenant:ccf41bd6460946949ea4583f548e5d96 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:52.453796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:52.462287 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:52.574106 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.579312 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.593658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-16fc2773-0148-4044-b7f4-446e2e25e4d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:52.626733 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55390) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:52.627343 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ccf41bd6460946949ea4583f548e5d96&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3388476 May 25 16:17:52.648752 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=916b318b-d21b-495f-953f-66e3bb57b310,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:52.652810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f7728cee-f2cb-4c5d-b0b2-9da5ac20a4d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:52.722831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.764386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.832330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.840148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2ff6d44b-6f71-4cea-b57d-129b619595bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:52.853185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=916b318b-d21b-495f-953f-66e3bb57b310,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:52.856586 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:52.858808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:52.862721 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/916b318b-d21b-495f-953f-66e3bb57b310 HTTP/1.1" status: 204 len: 168 time: 0.2339392 May 25 16:17:53.715634 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55428) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:53.839761 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-882757123-network', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:17:53.844902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:53.849015 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Usage tracker for resource:network and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:53.852223 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:53.858856 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:53.870326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Made reservation on behalf of a899ba7d8bc0472caa53a2e65d1bd7ea for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:17:53.872694 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:53.887629 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:53.907286 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:53.917595 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:53.921219 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:53.927592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:54.077131 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.083210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.091942 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f235c8c0-2dee-448b-b6c4-375dacb03d0a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:54.142631 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] vlan segment allocate from pool success with {'vlan_id': 828, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:17:54.169444 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acce15bb-f5e2-4fb7-8292-46061d719da1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:54.175989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:54.179832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.180270 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Added segment 9ea9a7f5-8525-4a9d-94f3-311c5943a532 of type vlan for network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a May 25 16:17:54.214994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.249559 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.251258 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:17:54.252020 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:54.256577 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a147a8e-9210-40b4-827b-29712ed5df65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:54.389463 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6720736 May 25 16:17:54.393139 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Pushing event updated for resources: {'Network': ['ID=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:54.393945 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55438) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:54.398042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:54.404271 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Request body: {'subnet': {'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-882757123-subnet', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:17:54.407934 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:17:54.416298 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:54.424210 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Usage tracker for resource:subnet and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:54.431363 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:54.444205 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:54.463284 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Made reservation on behalf of a899ba7d8bc0472caa53a2e65d1bd7ea for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:17:54.468899 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.053774 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.059735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:55.109493 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55452) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:55.142962 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Pushing event updated for resources: {'Subnet': ['ID=659f33e2-068d-40bb-84cc-c31f8933e023,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:55.148121 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:55.153383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:17:55.153747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Network hostable DHCP agents. Network: 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:17:55.176551 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:17:55.189592 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:17:55.204327 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:17:55.204773 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc5e1871-2776-4897-980c-641e4eeccae8 None None] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:17:55.205274 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.266038 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7d5ca521-d0d5-463d-8a92-4fac3a019b68 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8675759 May 25 16:17:55.266468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55458) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:55.275075 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:17:55.283011 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:55.289629 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Usage tracker for resource:router and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:55.294647 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:55.305671 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:55.323151 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.325477 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.332144 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.349814 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.362320 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:55.370644 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Usage tracker for resource:security_group_rule and tenant:169064f8b75b4ebbac659366bb61c59e is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:55.376447 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:55.388291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:55.545094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.551762 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.563907 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ccedbbc5-c0ef-42d2-ad31-d5669d54c1f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:55.581223 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:17:55.582717 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.613245 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=169064f8b75b4ebbac659366bb61c59e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5019717 May 25 16:17:55.613997 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55462) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:55.618633 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f6e8ea2-4cea-4495-9ba4-a9f418bbf58e,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:55.631164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7581e42f-20a4-400f-a8ea-45563536add4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:55.730962 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.786371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.861697 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Allocated IP 172.20.0.2 (0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a/659f33e2-068d-40bb-84cc-c31f8933e023/c5fb4dc4-d633-4c33-96fa-3dcace397ddf) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:17:55.884989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.892731 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-69f6bbca-3cf4-47b0-ae5f-322e59dc6b84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:55.908247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f6e8ea2-4cea-4495-9ba4-a9f418bbf58e,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:55.920056 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.920751 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.921308 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.921775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.922241 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.922753 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.923343 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.923922 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.924645 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.925220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.925797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.926399 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:55.929876 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:55.931738 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5f6e8ea2-4cea-4495-9ba4-a9f418bbf58e HTTP/1.1" status: 204 len: 168 time: 0.3155625 May 25 16:17:55.933326 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c3f72f71-99c6-405f-a4e7-c835c6ad82c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:55.943328 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.237428 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.250261 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Transition to ACTIVE for port object c5fb4dc4-d633-4c33-96fa-3dcace397ddf will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:17:56.271775 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Transition to ACTIVE for port object c5fb4dc4-d633-4c33-96fa-3dcace397ddf will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:17:56.279593 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.285095 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:56.353739 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:17:56.357021 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:17:56.361159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:17:56.370823 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Pushing event updated for resources: {'Port': ['ID=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:56.413985 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.414570 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.414831 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.415113 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.415784 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.416953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.416953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.416953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.417523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.417523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.417861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.418051 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:56.437134 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.448074 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:56.494479 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Attempting to bind port c5fb4dc4-d633-4c33-96fa-3dcace397ddf on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:17:56.494863 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Attempting to bind port c5fb4dc4-d633-4c33-96fa-3dcace397ddf by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:17:56.495237 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Attempting to bind port c5fb4dc4-d633-4c33-96fa-3dcace397ddf on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:17:56.501165 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.501629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 17, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:17:56.502025 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:17:56.502437 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.502840 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Bound using segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:17:56.503337 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Bound port: c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:17:56.503748 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.514902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55470) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:56.555770 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.571764 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:17:56.576504 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Usage tracker for resource:security_group_rule and tenant:5b3b19ae30a94d3d9b71f5153e2a88dc is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:17:56.581408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:17:56.592646 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:17:56.616588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] For port c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:17:56.622348 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] For port c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:17:56.628578 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.637508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:56.746879 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Allocated IP 172.27.1.207 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/1de33510-909d-4188-99b8-31e897566ed1) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:17:56.760718 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.766884 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.776921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-834d220c-34dc-4f5e-ae7f-d925ccaeed0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:56.805039 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Pushing event updated for resources: {'Port': ['ID=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:56.810229 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:56.823594 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5b3b19ae30a94d3d9b71f5153e2a88dc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3070006 May 25 16:17:56.824602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6312ffd1-15b9-4477-996c-54198ff01780,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:56.831374 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-91a0b1ab-4d07-4313-b67f-1abc83ae8a1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:56.831877 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55474) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:56.922846 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.963302 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:56.974684 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:57.020990 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:57.025744 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:57.094504 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:57.099014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-56d8280f-ecf7-4502-ad9a-21fb3fd67742 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:57.111867 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6312ffd1-15b9-4477-996c-54198ff01780,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:57.116182 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:57.120009 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:57.121279 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4daac8f4-5c11-499b-b071-19e255c00f2b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6312ffd1-15b9-4477-996c-54198ff01780 HTTP/1.1" status: 204 len: 168 time: 0.2884212 May 25 16:17:57.125644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:17:57.129080 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:17:57.131639 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:17:57.196619 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Pushing event updated for resources: {'Port': ['ID=1de33510-909d-4188-99b8-31e897566ed1,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:57.215195 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.215582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.216280 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.216701 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.217059 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.217417 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.217768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.218119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.218468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.218816 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.219161 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.219504 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:17:57.223532 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:57.727009 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:58.020301 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f3972d1-4743-4c5c-937e-22af3d497d9f None None] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:17:58.185361 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-0ee867fb-b876-4a01-a1a2-9fcc916440f7 None None] Provisioning for port c5fb4dc4-d633-4c33-96fa-3dcace397ddf completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:17:58.292566 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:58.534397 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Router a7599ba5-2a61-4148-b2df-718c47f35d9f is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:17:58.790594 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:17:58.813848 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:17:58.834426 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:17:58.835277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:17:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:17:58.837812 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:58.840120 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ec50b5e2-19d7-4494-be11-b317a8943725 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.5719271 May 25 16:17:58.842928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55502) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:17:58.944007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c5fb4dc4-d633-4c33-96fa-3dcace397ddf up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:17:59.217267 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port c5fb4dc4-d633-4c33-96fa-3dcace397ddf completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:17:59.230743 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:17:59.275989 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port c5fb4dc4-d633-4c33-96fa-3dcace397ddf triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:17:59.276371 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:59.471806 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5cc3d1d6-f70c-4391-8387-02033ce08f11 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:59.629730 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:59.693712 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:17:59.698627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:59.704305 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:17:59.769047 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:17:57Z', 'revision_number': 3, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:17:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:17:59.777476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:17:59.777813 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Updating router a7599ba5-2a61-4148-b2df-718c47f35d9f port 1de33510-909d-4188-99b8-31e897566ed1 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:17:59.833028 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:17:59.838614 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:17:59.847523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:17:59.858246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.162889 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Allocated IP 172.20.0.1 (0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a/659f33e2-068d-40bb-84cc-c31f8933e023/63bb2503-8a40-4c99-a763-b687d4db1c08) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:00.253306 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.274177 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Transition to ACTIVE for port object 1de33510-909d-4188-99b8-31e897566ed1 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:00.285466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.290972 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:00.342171 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.361761 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Transition to ACTIVE for port object 63bb2503-8a40-4c99-a763-b687d4db1c08 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:00.382578 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Attempting to bind port 1de33510-909d-4188-99b8-31e897566ed1 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:00.382957 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Attempting to bind port 1de33510-909d-4188-99b8-31e897566ed1 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:00.383320 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Attempting to bind port 1de33510-909d-4188-99b8-31e897566ed1 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:00.392627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Pushing event updated for resources: {'Port': ['ID=1de33510-909d-4188-99b8-31e897566ed1,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:00.393245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.402013 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 17, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:00.402229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7f368eec-f5d4-4b75-a34c-2328766d3bbd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:00.402351 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:00.402681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.403122 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:00.403795 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Bound port: 1de33510-909d-4188-99b8-31e897566ed1, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:00.404198 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.430575 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:00.489599 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] For port 1de33510-909d-4188-99b8-31e897566ed1, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:00.495098 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] For port 1de33510-909d-4188-99b8-31e897566ed1, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1de33510-909d-4188-99b8-31e897566ed1,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:00.498640 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.499478 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:00.503618 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:00.504416 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:00.510681 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:00.618417 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Pushing event updated for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:00.621911 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:00.628563 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.680777 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:00.683068 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:17:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:00.763097 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Pushing event updated for resources: {'Port': ['ID=1de33510-909d-4188-99b8-31e897566ed1,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:00.775244 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:00.794520 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c5fb4dc4-d633-4c33-96fa-3dcace397ddf up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:00.918831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:00.950318 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-8cc96f2e-48bb-40b2-b039-14e66ca46528 None None] Provisioning for port 63bb2503-8a40-4c99-a763-b687d4db1c08 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:00.962274 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:01.063407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-8cc96f2e-48bb-40b2-b039-14e66ca46528 None None] Provisioning complete for port 63bb2503-8a40-4c99-a763-b687d4db1c08 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:01.063903 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-8cc96f2e-48bb-40b2-b039-14e66ca46528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.209422 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-8cc96f2e-48bb-40b2-b039-14e66ca46528 None None] Port 63bb2503-8a40-4c99-a763-b687d4db1c08 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:01.216737 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port c5fb4dc4-d633-4c33-96fa-3dcace397ddf triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:01.217118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.368712 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.379963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.410138 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:01.451948 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:17:57Z', 'revision_number': 3, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:01.459289 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f54df61-87d7-44f2-b753-2c927bd8437b None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:17:57Z', 'revision_number': 3, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:01.503391 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.508045 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Pushing event updated for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:01.511788 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:01.633604 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:01.691032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:01.692978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:01.823282 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4cbf4cd5-5555-4c07-9a87-bf2ef1c2821c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:02.009875 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:18:02.058425 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-e4fb5e6b-03db-4cd6-92dd-a6ffe594c5ed None None] Provisioning complete for port 63bb2503-8a40-4c99-a763-b687d4db1c08 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:02.059096 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-e4fb5e6b-03db-4cd6-92dd-a6ffe594c5ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:02.127959 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-e4fb5e6b-03db-4cd6-92dd-a6ffe594c5ed None None] Port 63bb2503-8a40-4c99-a763-b687d4db1c08 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:02.259860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:02.279796 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] 10.222.0.25 "PUT /v2.0/routers/a7599ba5-2a61-4148-b2df-718c47f35d9f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4263027 May 25 16:18:02.817208 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1de33510-909d-4188-99b8-31e897566ed1 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:02.900935 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:02.920031 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 1de33510-909d-4188-99b8-31e897566ed1 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:02.925544 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 1de33510-909d-4188-99b8-31e897566ed1 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:02.925925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.065043 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.093469 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55534) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:03.096699 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 1de33510-909d-4188-99b8-31e897566ed1, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1de33510-909d-4188-99b8-31e897566ed1,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:03.100773 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-396884191-network', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:03.102088 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.104788 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:03.106330 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:03.110808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Usage tracker for resource:network and tenant:071fa67adcc445f7a4fb235d75abef7c is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:03.114298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:03.121534 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:03.135756 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Made reservation on behalf of 071fa67adcc445f7a4fb235d75abef7c for: {'network': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:03.138540 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.158110 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.191710 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=1de33510-909d-4188-99b8-31e897566ed1,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:03.191978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:03.195183 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:03.199206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Usage tracker for resource:security_group_rule and tenant:071fa67adcc445f7a4fb235d75abef7c is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:03.204903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:03.215175 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:03.269221 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:03.285211 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:03.285986 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:03.333652 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.338420 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.345762 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b6577b42-40dc-4f51-aa2c-7e184f9f9fb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:03.386698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] vlan segment allocate from pool success with {'vlan_id': 800, 'physical_network': 'physnet1'} {{(pid=98392) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:18:03.397420 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cdbdb4d-9753-436b-ad8b-cbd08728b594,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:03.401415 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:03.405108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.405108 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.segments_db [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Added segment 84c0121f-ea27-4a7d-a8a0-592be916b665 of type vlan for network 65e6b112-9bac-41d1-bbe8-8197e6a41377 May 25 16:18:03.451382 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.492065 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.494347 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:03.495002 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.500823 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6a0c129e-7efe-4516-8acd-1b6961417b8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:03.560892 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:03.607301 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5085311 May 25 16:18:03.608204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55538) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:03.609222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Pushing event updated for resources: {'Network': ['ID=65e6b112-9bac-41d1-bbe8-8197e6a41377,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:03.619418 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Request body: {'subnet': {'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-396884191-subnet', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'ip_version': 4}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:03.622899 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:18:03.624716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:03.628497 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:03.635040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Usage tracker for resource:subnet and tenant:071fa67adcc445f7a4fb235d75abef7c is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:03.638410 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:03.649251 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:03.669805 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Made reservation on behalf of 071fa67adcc445f7a4fb235d75abef7c for: {'subnet': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:03.672699 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3745239'] for subnet, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:03.989974 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:01Z', 'revision_number': 2, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:03.995025 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:03.995400 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Updating router a7599ba5-2a61-4148-b2df-718c47f35d9f port 63bb2503-8a40-4c99-a763-b687d4db1c08 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:04.056937 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.181116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3356678', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3745217'] for subnet, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.185322 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:04.266567 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Pushing event updated for resources: {'Subnet': ['ID=02b1c689-b89a-486d-9043-2b95b5a02dad,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:04.269366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:04.280642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Checking segment: {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:04.281253 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Network hostable DHCP agents. Network: 65e6b112-9bac-41d1-bbe8-8197e6a41377, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98392) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:18:04.310830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98392) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:18:04.328180 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 65e6b112-9bac-41d1-bbe8-8197e6a41377) {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:04.338133 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:04.338732 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.340501 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d851cee-ba94-4cc6-8bbb-05c6e39d2797 None None] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:04.370334 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-08b89306-8164-458a-9aea-ae4fe1d8bf10 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7577815 May 25 16:18:04.373248 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55546) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:04.382164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:04.390902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:04.399246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Usage tracker for resource:router and tenant:071fa67adcc445f7a4fb235d75abef7c is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:04.404481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:04.415773 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:04.435015 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.436831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.469388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.542554 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.563991 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Transition to ACTIVE for port object 63bb2503-8a40-4c99-a763-b687d4db1c08 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:04.576201 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.586400 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:04.605431 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.694916 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-65e6b112-9bac-41d1-bbe8-8197e6a41377', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:18:04.695957 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:04.751531 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Pushing event updated for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:04.988344 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.988996 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.989940 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.990838 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.992123 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.992703 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.993342 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.993980 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.994655 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.995305 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.995977 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:04.996795 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98394) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:05.002980 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Attempting to bind port 63bb2503-8a40-4c99-a763-b687d4db1c08 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:05.003747 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Attempting to bind port 63bb2503-8a40-4c99-a763-b687d4db1c08 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:05.004415 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Attempting to bind port 63bb2503-8a40-4c99-a763-b687d4db1c08 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:05.011284 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:05.016571 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:05.017438 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:05.018163 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.018849 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Bound using segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:05.019720 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Bound port: 63bb2503-8a40-4c99-a763-b687d4db1c08, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:05.020608 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.025800 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1de33510-909d-4188-99b8-31e897566ed1 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:05.234785 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] For port 63bb2503-8a40-4c99-a763-b687d4db1c08, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:05.247133 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] For port 63bb2503-8a40-4c99-a763-b687d4db1c08, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=63bb2503-8a40-4c99-a763-b687d4db1c08,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:05.257868 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.283537 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:05.310551 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.350079 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 1de33510-909d-4188-99b8-31e897566ed1 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:05.351505 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.367450 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:05.368253 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:05.466234 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Pushing event updated for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:05.479059 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:05.481573 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Allocated IP 172.20.0.2 (65e6b112-9bac-41d1-bbe8-8197e6a41377/02b1c689-b89a-486d-9043-2b95b5a02dad/cf18ab87-678c-4e70-bdd7-eda7cc40ebf6) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:05.594272 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:05.808001 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.845423 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:05.994452 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:05Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:05.998706 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77981d63-ec63-4ffc-9976-48af03c7e368 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:05Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:06.012831 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.020175 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Allocated IP 172.27.1.99 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/913bd645-8ded-4389-a7b8-766f2aa204fb) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:06.031140 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Transition to ACTIVE for port object cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:06.081326 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Transition to ACTIVE for port object cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:06.097262 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.107031 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c5cc54fc-3402-4097-8bf4-b81d35b881f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:06.225309 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:06.231407 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:06.235663 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:06.329391 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Pushing event updated for resources: {'Port': ['ID=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:06.329773 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.335529 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:06.372074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.376306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0e55c7bb-eb67-4695-8fc8-fb7983b3211e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:06.404220 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.447896 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Attempting to bind port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:06.448252 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Attempting to bind port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:06.448849 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Attempting to bind port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 on network 65e6b112-9bac-41d1-bbe8-8197e6a41377 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:06.451512 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:06.455400 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:06.459539 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:06.461401 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:06.462369 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Checking segment: {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:06.463346 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.464060 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Bound using segment: {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:06.464916 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Bound port: cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:06.465571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.497796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Pushing event updated for resources: {'Port': ['ID=913bd645-8ded-4389-a7b8-766f2aa204fb,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:06.502757 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:06.622193 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] For port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:06.626709 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] For port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:06.633262 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:06.643719 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:06.745173 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Pushing event updated for resources: {'Port': ['ID=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:06.748769 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:06.889080 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 63bb2503-8a40-4c99-a763-b687d4db1c08 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:07.058374 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 63bb2503-8a40-4c99-a763-b687d4db1c08 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:07.067713 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 63bb2503-8a40-4c99-a763-b687d4db1c08 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:07.068344 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:07.113338 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:07.283203 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:07.329657 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 63bb2503-8a40-4c99-a763-b687d4db1c08, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=63bb2503-8a40-4c99-a763-b687d4db1c08,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:07.336359 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:07.340241 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:07.434426 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:07.440698 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:07.868615 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:07.961941 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-666361ea-b11d-402b-9535-3193948f89b1 None None] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:08.118035 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-b75e213e-5a07-4c40-b042-58c4ea74a92d None None] Provisioning for port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:08.164593 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Router eb166b1f-c9b6-41c0-93f2-1954db943b43 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98392) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:18:08.365243 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:08.376265 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Sync routers for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:08.398905 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:08.400885 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 4.0259476 May 25 16:18:08.403933 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:08.405012 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:08.405306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55560) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:08.756792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:08.974118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 63bb2503-8a40-4c99-a763-b687d4db1c08 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:09.205065 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 63bb2503-8a40-4c99-a763-b687d4db1c08 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:09.205329 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.363062 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:06Z', 'revision_number': 3, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:09.374851 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:09.399272 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Checking router: eb166b1f-c9b6-41c0-93f2-1954db943b43 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:09.399655 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Updating router eb166b1f-c9b6-41c0-93f2-1954db943b43 port 913bd645-8ded-4389-a7b8-766f2aa204fb binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:09.402917 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.484070 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.627973 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:09.652024 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:09.652601 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.695842 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Allocated IP 172.20.0.1 (65e6b112-9bac-41d1-bbe8-8197e6a41377/02b1c689-b89a-486d-9043-2b95b5a02dad/64a0d5a5-3221-4b1d-a541-c372770cc636) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:09.866829 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.884455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Transition to ACTIVE for port object 64a0d5a5-3221-4b1d-a541-c372770cc636 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:09.909040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:09.919820 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:09.996104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:10.005220 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:10.015094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:10.091710 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Pushing event updated for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:10.094834 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:10.105046 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.164227 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.174718 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.196332 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Transition to ACTIVE for port object 913bd645-8ded-4389-a7b8-766f2aa204fb will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:10.208927 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.213966 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-a58c6788-84c4-47a2-abd4-55284af5d86f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:10.286760 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.304006 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:10.320642 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.325963 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02578724-4697-4ea4-9c29-db7f7a500f8f None None] Pushing event updated for resources: {'Port': ['ID=913bd645-8ded-4389-a7b8-766f2aa204fb,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:10.330579 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Attempting to bind port 913bd645-8ded-4389-a7b8-766f2aa204fb on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:10.331159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Attempting to bind port 913bd645-8ded-4389-a7b8-766f2aa204fb by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:10.331767 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Attempting to bind port 913bd645-8ded-4389-a7b8-766f2aa204fb on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:10.336230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-02578724-4697-4ea4-9c29-db7f7a500f8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:10.340292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:10.383159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:10.383928 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:10.384410 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.385009 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:10.385616 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Bound port: 913bd645-8ded-4389-a7b8-766f2aa204fb, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:10.386103 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.479897 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5cb9d07f-0408-4b2a-b68d-41a893a714b9 None None] Provisioning for port 64a0d5a5-3221-4b1d-a541-c372770cc636 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:10.504904 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:10.510014 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5cb9d07f-0408-4b2a-b68d-41a893a714b9 None None] Provisioning complete for port 64a0d5a5-3221-4b1d-a541-c372770cc636 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:10.510597 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5cb9d07f-0408-4b2a-b68d-41a893a714b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.542688 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:10.579760 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] For port 913bd645-8ded-4389-a7b8-766f2aa204fb, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:10.598602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] For port 913bd645-8ded-4389-a7b8-766f2aa204fb, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=913bd645-8ded-4389-a7b8-766f2aa204fb,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:10.602524 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-5cb9d07f-0408-4b2a-b68d-41a893a714b9 None None] Port 64a0d5a5-3221-4b1d-a541-c372770cc636 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:10.605824 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.610840 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:10.619195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.627241 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.658857 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0615a8fd-e597-40ec-bf0e-fd1a426a3586 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:10.699251 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:10.699889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:10.751099 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02578724-4697-4ea4-9c29-db7f7a500f8f None None] Pushing event updated for resources: {'Port': ['ID=913bd645-8ded-4389-a7b8-766f2aa204fb,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:10.760106 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-02578724-4697-4ea4-9c29-db7f7a500f8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:10.792596 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Pushing event updated for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:10.799670 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:10.804971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:10.904145 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:11.007148 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:11.022091 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:11.024691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:11.087433 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:11.087836 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:11.343750 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Router eb166b1f-c9b6-41c0-93f2-1954db943b43 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:18:11.516723 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-6deb4446-acb9-4f13-a8c8-c7990d5cc2f1 None None] Provisioning complete for port 64a0d5a5-3221-4b1d-a541-c372770cc636 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:11.517602 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6deb4446-acb9-4f13-a8c8-c7990d5cc2f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:11.649861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-6deb4446-acb9-4f13-a8c8-c7990d5cc2f1 None None] Port 64a0d5a5-3221-4b1d-a541-c372770cc636 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:11.693515 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '64a0d5a5-3221-4b1d-a541-c372770cc636', 'name': '', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'mac_address': 'fa:16:3e:c5:1e:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:09Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 2, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'subnets': [{'id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:11.701850 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5383bb69-4063-48ec-bef0-9baceeb14149 None None] The sync data for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi is: [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '64a0d5a5-3221-4b1d-a541-c372770cc636', 'name': '', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'mac_address': 'fa:16:3e:c5:1e:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:09Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 2, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'subnets': [{'id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:11.837177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:11.849350 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] 10.222.0.25 "PUT /v2.0/routers/eb166b1f-c9b6-41c0-93f2-1954db943b43/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4428606 May 25 16:18:12.844764 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 913bd645-8ded-4389-a7b8-766f2aa204fb up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:12.938259 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 913bd645-8ded-4389-a7b8-766f2aa204fb completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:12.953350 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 913bd645-8ded-4389-a7b8-766f2aa204fb triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:12.953748 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:13.133155 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:13.157268 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 913bd645-8ded-4389-a7b8-766f2aa204fb, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=913bd645-8ded-4389-a7b8-766f2aa204fb,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:13.164842 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:13.172056 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:13.257917 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=913bd645-8ded-4389-a7b8-766f2aa204fb,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:13.261844 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:13.806557 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55588) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:13.812803 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-714553222', 'description': 'tempest-secgroup-smoke-714553222 description', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:13.819360 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:13.824640 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:13.828907 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:13.835736 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:13.848595 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:13.872798 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:13.877619 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:13.881126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:13.888772 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:13.995713 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.001272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.011331 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d9e19240-ee54-421a-8c06-8021a69fe843 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:14.088275 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.090420 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.2824991 May 25 16:18:14.092068 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5265a9e-7809-4275-93e5-3ff80a9af0d2,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:14.094167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55592) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:14.096734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f907d252-ed8d-4b8e-af69-1d4aaed2ee77 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:14.105692 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:14.118569 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:14.124553 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:14.128119 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:14.135211 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:14.154911 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.251093 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.257570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.271939 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-14ead206-590e-41cc-af64-f82a2570aae4 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:14.289476 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Sync routers for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:14.311324 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:14.313968 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:14.317780 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7774a23f-dc66-43fb-8cfd-c032739f8264,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:14.323927 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:14.327056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.334475 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55600) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:14.335675 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-49c3b090-261a-485a-93a8-789f76294674 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2396324 May 25 16:18:14.345277 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:14.358872 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:14.364291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:14.369864 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:14.377837 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:14.399460 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.518270 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.525003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.528661 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ff26b19a-23ed-4ead-b4a9-2452922c0884 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:14.566242 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c7ad741-c638-4d37-b556-3e01c5caf7f7,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:14.575860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:14.587603 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.589807 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-0513db0b-b615-4897-acac-11108ddbfe49 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2534757 May 25 16:18:14.592615 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55614) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:14.601743 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:14.611787 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:14.617873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:14.622581 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:14.634133 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:14.663771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.680998 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:14.808321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.815404 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.834349 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:14.834625 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 913bd645-8ded-4389-a7b8-766f2aa204fb up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:14.864604 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=041d6214-4f1e-434a-9b22-19423e0302db,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:14.875099 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:14.891932 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:14.891932 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-64637d59-42a9-431b-a1aa-6b90f747465f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2889683 May 25 16:18:14.892286 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55624) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:14.901450 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:14.923622 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:14.927021 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:14.931140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:14.939208 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:14.966702 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.000509 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 913bd645-8ded-4389-a7b8-766f2aa204fb triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:15.000978 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.119056 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.127987 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.132068 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:15.170178 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e276e176-27a9-4aea-865f-a902c76010cb,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:15.185068 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:15.195422 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.197458 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3079848 May 25 16:18:15.201566 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55636) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:15.210428 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:15.224553 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:15.232206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:15.237876 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:15.248853 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:15.266022 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.securitygroups_db [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Project a899ba7d8bc0472caa53a2e65d1bd7ea added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 16:18:15.281245 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '64a0d5a5-3221-4b1d-a541-c372770cc636', 'name': '', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'mac_address': 'fa:16:3e:c5:1e:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:09Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 2, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'subnets': [{'id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:15.281540 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.285291 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Checking router: eb166b1f-c9b6-41c0-93f2-1954db943b43 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:15.285907 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Updating router eb166b1f-c9b6-41c0-93f2-1954db943b43 port 64a0d5a5-3221-4b1d-a541-c372770cc636 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:15.384351 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.389167 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.396968 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.400471 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-96e59552-b330-436c-95b2-75ee1eaffb59 tempest-TestShelveInstance-1868010358 tempest-TestShelveInstance-1868010358-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:15.425849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ae85126-a0fc-432e-8904-15203e98e260,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:15.428329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:15.437635 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.438940 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-77448ec0-9b91-4fd3-890c-5dec805ce6ee tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2355521 May 25 16:18:15.442541 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55648) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:15.452842 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'security_group_rule': {'security_group_id': 'a5265a9e-7809-4275-93e5-3ff80a9af0d2', 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:15.464835 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:15.480802 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:security_group_rule and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:15.486971 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:15.498974 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:15.531672 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.securitygroups_db [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Project a899ba7d8bc0472caa53a2e65d1bd7ea added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 16:18:15.538710 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.638495 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.646238 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.650156 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-213c4336-14dc-4630-ba96-d482d7266653 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:15.698824 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=10ff1e69-9f21-4fa0-b889-6deb5fd67268,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:15.702860 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:15.713192 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.714828 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-7e7d1966-c7d7-42d7-8e22-dedb7ee722a3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2706416 May 25 16:18:15.802425 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.816601 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Transition to ACTIVE for port object 64a0d5a5-3221-4b1d-a541-c372770cc636 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:15.825088 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:15.831913 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-52a83e3d-a0da-400b-8446-38860780721f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:15.934471 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09fa8be-d563-4b93-851e-0fc443791884 None None] Pushing event updated for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:16.180932 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-b09fa8be-d563-4b93-851e-0fc443791884 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.349s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:16.235469 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Attempting to bind port 64a0d5a5-3221-4b1d-a541-c372770cc636 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:16.236150 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Attempting to bind port 64a0d5a5-3221-4b1d-a541-c372770cc636 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:16.236756 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Attempting to bind port 64a0d5a5-3221-4b1d-a541-c372770cc636 on network 65e6b112-9bac-41d1-bbe8-8197e6a41377 {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:16.247245 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:16.247804 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Checking segment: {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:16.248330 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:16.248846 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Bound using segment: {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:16.249684 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Bound port: 64a0d5a5-3221-4b1d-a541-c372770cc636, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '84c0121f-ea27-4a7d-a8a0-592be916b665', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:16.250113 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:16.359333 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] For port 64a0d5a5-3221-4b1d-a541-c372770cc636, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:16.362818 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] For port 64a0d5a5-3221-4b1d-a541-c372770cc636, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=64a0d5a5-3221-4b1d-a541-c372770cc636,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:16.370037 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:16.375574 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:16.458668 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09fa8be-d563-4b93-851e-0fc443791884 None None] Pushing event updated for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:16.462981 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-b09fa8be-d563-4b93-851e-0fc443791884 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:16.475029 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:16.476245 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:16.794733 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:16.898247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 64a0d5a5-3221-4b1d-a541-c372770cc636 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:17.035516 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 64a0d5a5-3221-4b1d-a541-c372770cc636 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:17.041938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 64a0d5a5-3221-4b1d-a541-c372770cc636 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:17.042506 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:17.202299 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:17.261561 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 64a0d5a5-3221-4b1d-a541-c372770cc636, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=64a0d5a5-3221-4b1d-a541-c372770cc636,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:17.266905 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:17.268940 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-cad114ab-9bbe-441d-a95f-3b94b5a42cc5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:17.287183 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '64a0d5a5-3221-4b1d-a541-c372770cc636', 'name': '', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'mac_address': 'fa:16:3e:c5:1e:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:09Z', 'updated_at': '2021-05-25T16:18:16Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'subnets': [{'id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:17.292644 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-885f7640-36c3-46ab-a240-6ec13487e0a3 None None] The sync data for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi is: [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:18:10Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '64a0d5a5-3221-4b1d-a541-c372770cc636', 'name': '', 'network_id': '65e6b112-9bac-41d1-bbe8-8197e6a41377', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'mac_address': 'fa:16:3e:c5:1e:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_interface', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:09Z', 'updated_at': '2021-05-25T16:18:16Z', 'revision_number': 4, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'subnets': [{'id': '02b1c689-b89a-486d-9043-2b95b5a02dad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:17.355931 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:17.359912 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:18.824367 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 64a0d5a5-3221-4b1d-a541-c372770cc636 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:18.906829 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 64a0d5a5-3221-4b1d-a541-c372770cc636 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:18.907205 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:20.972832 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55750) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:21.132810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.147814 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:21.151780 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Usage tracker for resource:security_group_rule and tenant:efb25651485841c790d1b3914c191cf7 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:21.154764 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:21.160802 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:21.257995 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.262555 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.270214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ee8f81b9-a99f-4bb5-b61b-54a8d501b627 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:21.322007 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=efb25651485841c790d1b3914c191cf7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3476286 May 25 16:18:21.322801 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c16b43c-8ae6-4c0e-a0fc-3ab3a8ceb888,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:21.327597 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 55756) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:21.328240 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2c6e6986-8ba1-4c37-bf1f-485d53d60bab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:21.389225 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.417345 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.483988 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.488497 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:21.500738 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c16b43c-8ae6-4c0e-a0fc-3ab3a8ceb888,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:21.504626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:21.509117 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:21.510325 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-80bcb5a6-e69e-4946-9d75-5a9a4a883f49 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1c16b43c-8ae6-4c0e-a0fc-3ab3a8ceb888 HTTP/1.1" status: 204 len: 168 time: 0.1831703 May 25 16:18:22.385223 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55782) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:22.535517 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-850645996-network', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:22.540859 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:22.545310 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Usage tracker for resource:network and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:22.548729 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:22.557140 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:22.569893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Made reservation on behalf of 5d2ebdea3bd843dfbaea75179867aaa5 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:22.573176 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.587509 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.603422 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:22.607634 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:22.610778 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:22.619441 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:22.746998 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.751925 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.755053 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-7b1e3a3d-85b9-4a4a-bbf9-3aa57656b2af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:22.781657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] vlan segment allocate from pool success with {'vlan_id': 840, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:18:22.795626 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:22.800871 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:22.802027 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.802444 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Added segment f7170f64-429b-4536-8abe-e62f660fad02 of type vlan for network 62d43163-f679-4f52-9314-5c4893113cf3 May 25 16:18:22.836122 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.876664 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.878039 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:22.878621 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:22.882866 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:22.993387 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Pushing event updated for resources: {'Network': ['ID=62d43163-f679-4f52-9314-5c4893113cf3,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:22.996351 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:22.998854 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-281c8c6d-1f5e-4a48-9de5-075e1f9fabb4 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6118226 May 25 16:18:23.003575 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55788) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:23.009040 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 62d43163-f679-4f52-9314-5c4893113cf3 details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:18:23.009724 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Request body: {'subnet': {'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-850645996-subnet', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:23.014585 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:23.018647 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Usage tracker for resource:subnet and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:23.021915 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:23.029063 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:23.042183 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Made reservation on behalf of 5d2ebdea3bd843dfbaea75179867aaa5 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:23.044666 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:23.688412 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:23.694739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-9bba4f45-27ef-4f74-84b0-c17b3483e44d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:23.774528 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Pushing event updated for resources: {'Subnet': ['ID=34f9fa10-b0a2-4008-8b3a-e7097da2d46a,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:23.779595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:23.790590 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Checking segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:23.791013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Network hostable DHCP agents. Network: 62d43163-f679-4f52-9314-5c4893113cf3, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:18:23.813642 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Network 62d43163-f679-4f52-9314-5c4893113cf3 is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:18:23.826729 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 62d43163-f679-4f52-9314-5c4893113cf3) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:23.840239 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eceff2cf-96a1-4d79-b05b-ce77c761bb6d None None] Network 62d43163-f679-4f52-9314-5c4893113cf3 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:23.849936 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:23.850978 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:23.882548 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-8e80c8b1-5277-4371-bc74-50cbdcc4a634 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.8771780 May 25 16:18:23.887215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55794) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:23.893258 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:23.898950 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:23.903905 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Usage tracker for resource:router and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:23.907504 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:23.914796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:23.930459 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:23.931898 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:23.958468 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.138434 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-62d43163-f679-4f52-9314-5c4893113cf3', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:18:24.139783 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.362323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.429788 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Allocated IP 172.20.0.2 (62d43163-f679-4f52-9314-5c4893113cf3/34f9fa10-b0a2-4008-8b3a-e7097da2d46a/2c833278-744a-4936-a9b2-f2841ee1f096) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:24.738150 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.757277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Transition to ACTIVE for port object 2c833278-744a-4936-a9b2-f2841ee1f096 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:24.781949 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.789921 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Transition to ACTIVE for port object 2c833278-744a-4936-a9b2-f2841ee1f096 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:24.797012 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.801347 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-c28fe0e7-6b27-43c8-b553-ff2a19c4deee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:24.817013 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:24.875790 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Network 62d43163-f679-4f52-9314-5c4893113cf3 is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:24.879172 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:24.883513 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:24.889816 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Pushing event updated for resources: {'Port': ['ID=2c833278-744a-4936-a9b2-f2841ee1f096,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:24.893864 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:24.978385 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Allocated IP 172.27.1.29 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/d0938a43-4529-4009-ac8b-6af8adc4bb26) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:24.993283 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Attempting to bind port 2c833278-744a-4936-a9b2-f2841ee1f096 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:24.993656 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Attempting to bind port 2c833278-744a-4936-a9b2-f2841ee1f096 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:24.994028 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Attempting to bind port 2c833278-744a-4936-a9b2-f2841ee1f096 on network 62d43163-f679-4f52-9314-5c4893113cf3 {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:25.000265 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:25.000631 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Checking segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:25.001051 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:25.001479 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Bound using segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:25.002123 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Bound port: 2c833278-744a-4936-a9b2-f2841ee1f096, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:25.002450 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:25.129997 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] For port 2c833278-744a-4936-a9b2-f2841ee1f096, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:25.135842 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] For port 2c833278-744a-4936-a9b2-f2841ee1f096, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=2c833278-744a-4936-a9b2-f2841ee1f096,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:25.142063 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:25.148090 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-dd236e4f-ee0b-49c1-bff2-2415c5304f77 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:25.176948 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:25.217378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:25.222703 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5b26fbc4-9267-4dbc-b177-4e974c977929 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:25.281580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Pushing event updated for resources: {'Port': ['ID=2c833278-744a-4936-a9b2-f2841ee1f096,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:25.285091 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:25.286866 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:25.289264 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:25.291466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:25.362204 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Pushing event updated for resources: {'Port': ['ID=d0938a43-4529-4009-ac8b-6af8adc4bb26,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:25.365729 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:25.989211 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:26.408530 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:26.442721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74c517e9-b45f-4428-9db3-dc74fb5e28d1 None None] Network 62d43163-f679-4f52-9314-5c4893113cf3 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:26.606644 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-47c98dcc-ba76-495d-8d7c-0ca6b8a8295a None None] Provisioning for port 2c833278-744a-4936-a9b2-f2841ee1f096 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:26.779004 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Router 51108221-2082-49d6-b061-0b7c1c457d96 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:18:26.907061 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 2c833278-744a-4936-a9b2-f2841ee1f096 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:26.989214 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port 2c833278-744a-4936-a9b2-f2841ee1f096 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:26.995882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 2c833278-744a-4936-a9b2-f2841ee1f096 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:26.996266 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:27.074994 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:27.103837 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Sync routers for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:27.115336 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:27.122345 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 3.2290432 May 25 16:18:27.122345 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55804) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:27.154967 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:27.156123 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:27.384247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:27.548516 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-d4e98d52-0208-4228-a952-eb435f661f86 None None] Provisioning complete for port 2c833278-744a-4936-a9b2-f2841ee1f096 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:27.549418 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d4e98d52-0208-4228-a952-eb435f661f86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:27.712308 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port 2c833278-744a-4936-a9b2-f2841ee1f096, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=2c833278-744a-4936-a9b2-f2841ee1f096,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:27.726751 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:27.738161 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f3db824e-3ccf-4b9a-9a74-efd223859b49 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:27.817756 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:28.089118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=2c833278-744a-4936-a9b2-f2841ee1f096,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:28.101544 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.363s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:28.337842 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:28.375784 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:25Z', 'revision_number': 3, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:28.383938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Checking router: 51108221-2082-49d6-b061-0b7c1c457d96 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:28.384616 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Updating router 51108221-2082-49d6-b061-0b7c1c457d96 port d0938a43-4529-4009-ac8b-6af8adc4bb26 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:28.429944 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:18:28.493458 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:28.704300 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Allocated IP 172.20.0.1 (62d43163-f679-4f52-9314-5c4893113cf3/34f9fa10-b0a2-4008-8b3a-e7097da2d46a/e727c6d0-b122-4b8d-b0ef-9174992e8f76) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:28.860137 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 2c833278-744a-4936-a9b2-f2841ee1f096 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:28.943469 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:28.966276 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Transition to ACTIVE for port object e727c6d0-b122-4b8d-b0ef-9174992e8f76 will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:29.006539 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.014831 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ea917d93-8409-4478-b568-f718f891d47a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:29.027295 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port 2c833278-744a-4936-a9b2-f2841ee1f096 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:29.027914 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.077224 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.102701 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Transition to ACTIVE for port object d0938a43-4529-4009-ac8b-6af8adc4bb26 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:29.118621 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.124118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-404d4a3b-2016-49a3-90d9-a70ad30ad19a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:29.148984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Network 62d43163-f679-4f52-9314-5c4893113cf3 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:29.154717 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:29.162307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:29.238396 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Pushing event updated for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:29.259784 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:29.282954 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.353613 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e42f80-c754-41f7-b7d8-922ff0c02900 None None] Pushing event updated for resources: {'Port': ['ID=d0938a43-4529-4009-ac8b-6af8adc4bb26,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:29.363069 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Attempting to bind port d0938a43-4529-4009-ac8b-6af8adc4bb26 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:29.363687 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Attempting to bind port d0938a43-4529-4009-ac8b-6af8adc4bb26 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:29.364285 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Attempting to bind port d0938a43-4529-4009-ac8b-6af8adc4bb26 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:29.391992 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f1e42f80-c754-41f7-b7d8-922ff0c02900 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:29.405981 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5056fc40-7ec2-4c0c-97e1-7318e362b16f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.413732 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:29.414352 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:29.415362 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.416121 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:29.416956 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Bound port: d0938a43-4529-4009-ac8b-6af8adc4bb26, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:29.418006 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.557065 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] For port d0938a43-4529-4009-ac8b-6af8adc4bb26, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:29.562766 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] For port d0938a43-4529-4009-ac8b-6af8adc4bb26, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d0938a43-4529-4009-ac8b-6af8adc4bb26,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:29.565196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-892ec101-ea28-4f2a-a414-da8401cc03fc None None] Provisioning for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:29.574908 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.583453 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:29.638460 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-892ec101-ea28-4f2a-a414-da8401cc03fc None None] Provisioning complete for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:29.639372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-892ec101-ea28-4f2a-a414-da8401cc03fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.735706 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:29.765572 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-892ec101-ea28-4f2a-a414-da8401cc03fc None None] Port e727c6d0-b122-4b8d-b0ef-9174992e8f76 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:29.771405 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:29.772086 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:29.917972 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e42f80-c754-41f7-b7d8-922ff0c02900 None None] Pushing event updated for resources: {'Port': ['ID=d0938a43-4529-4009-ac8b-6af8adc4bb26,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:29.921251 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f1e42f80-c754-41f7-b7d8-922ff0c02900 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:30.045228 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:30.097075 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:30.103836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:30.157086 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:30.311323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Pushing event updated for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:30.315902 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:30.324046 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:30.424499 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:28Z', 'revision_number': 1, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:30.432279 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8639e66-0f88-48a1-b271-463998829da9 None None] The sync data for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi is: [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:28Z', 'revision_number': 1, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:30.639756 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Network 62d43163-f679-4f52-9314-5c4893113cf3 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:30.643823 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:30.970809 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Router 51108221-2082-49d6-b061-0b7c1c457d96 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:18:31.010149 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-3935a723-9a6d-43b3-b535-5fe523e62a23 None None] Provisioning complete for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:31.010771 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3935a723-9a6d-43b3-b535-5fe523e62a23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:31.104729 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-3935a723-9a6d-43b3-b535-5fe523e62a23 None None] Port e727c6d0-b122-4b8d-b0ef-9174992e8f76 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:31.245810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:31.260546 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c61d6ecb-535f-452c-8387-1bc807eb65a1 admin admin] 10.222.0.25 "PUT /v2.0/routers/51108221-2082-49d6-b061-0b7c1c457d96/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1361878 May 25 16:18:31.613761 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:31.810818 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a53dd6e9-aca8-4c6e-95c5-f4411437976c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:31.914400 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55842) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:31.920348 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-506796955-network', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:31.925295 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:31.929980 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Usage tracker for resource:network and tenant:603cb1c40ecf43fb85588002c1d85e19 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:31.933120 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:31.940404 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:31.951181 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Made reservation on behalf of 603cb1c40ecf43fb85588002c1d85e19 for: {'network': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:31.953646 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1623296'] for network, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:31.966230 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:31.982221 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:31.986318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Usage tracker for resource:security_group_rule and tenant:603cb1c40ecf43fb85588002c1d85e19 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:31.989405 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:31.996237 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:32.086428 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.091735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.095403 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b0ac0a49-e785-4f0c-bd03-1c9e277ca0db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:32.126378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] vlan segment allocate from pool success with {'vlan_id': 842, 'physical_network': 'physnet1'} {{(pid=98391) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:18:32.135743 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=850630c5-edaf-4181-8d45-78b1aa6424f2,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:32.139665 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:32.143286 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.143965 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.segments_db [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Added segment 88cde3e6-4797-40ec-b8a3-f95a39764df7 of type vlan for network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b May 25 16:18:32.177984 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8792484352085'] for network, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.214901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688'] for network, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.216757 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:32.217457 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.221490 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:32.323859 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Pushing event updated for resources: {'Network': ['ID=5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:32.327485 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:32.331060 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-a0c15897-f947-4bc1-ac83-dce1c39c904e admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4152801 May 25 16:18:32.333582 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55846) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:32.340893 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Request body: {'subnet': {'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-506796955-subnet', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'ip_version': 4}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:32.341940 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b details requested by agent ovs-agent-dv-cinder-786383-6-iscsi with host dv-cinder-786383-6-iscsi {{(pid=98393) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:18:32.346570 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:32.351238 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Usage tracker for resource:subnet and tenant:603cb1c40ecf43fb85588002c1d85e19 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:32.354848 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:32.360956 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:32.374350 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Made reservation on behalf of 603cb1c40ecf43fb85588002c1d85e19 for: {'subnet': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:32.376877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2192382'] for subnet, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.680032 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Sync routers for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:32.703923 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:32.703923 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:32.861882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d0938a43-4529-4009-ac8b-6af8adc4bb26 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:32.934622 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3708732', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2192360'] for subnet, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.942575 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:32.951198 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:32.992912 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port d0938a43-4529-4009-ac8b-6af8adc4bb26 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:32.998651 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port d0938a43-4529-4009-ac8b-6af8adc4bb26 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:32.999032 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.050066 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:33.089084 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:33.093337 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:33.094265 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Checking segment: {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:33.094628 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Network hostable DHCP agents. Network: 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b, hostable agents: ['680893bc-c575-4d30-8dfa-d002c6f9bb5e'], hosted agents: [] {{(pid=98391) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:18:33.118416 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b is scheduled to be hosted by DHCP agent 680893bc-c575-4d30-8dfa-d002c6f9bb5e with binding_index 1 {{(pid=98391) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:18:33.133601 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786383-6-iscsi, 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b) {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:33.143504 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:33.144137 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.153443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.162304 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ff8e9f2-db25-486a-82b2-b868298cb586 None None] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:33.173440 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-60c3a461-ea55-4995-8e14-98a9f0fc617d admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.8382719 May 25 16:18:33.176896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55852) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:33.183380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:33.190746 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:33.196768 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Usage tracker for resource:router and tenant:603cb1c40ecf43fb85588002c1d85e19 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:33.200031 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:33.208225 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:33.222796 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-406360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2887'] for router, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.224836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-405848', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-408199', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-470890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2892'] for router, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.263284 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.271625 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port d0938a43-4529-4009-ac8b-6af8adc4bb26, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d0938a43-4529-4009-ac8b-6af8adc4bb26,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:33.280083 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.284910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-1b224f25-2289-42bc-918b-ecd270ca4d91 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:33.424721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=d0938a43-4529-4009-ac8b-6af8adc4bb26,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:33.430114 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:33.521855 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpbe663bed-6984-572c-9c1e-890e00f9f7c8-5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'fixed_ips': [{'subnet_id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3'}]}} from dv-cinder-786383-6-iscsi. {{(pid=98393) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:18:33.523918 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.555957 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 2, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:33.560602 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Checking router: 51108221-2082-49d6-b061-0b7c1c457d96 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:33.560969 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Updating router 51108221-2082-49d6-b061-0b7c1c457d96 port e727c6d0-b122-4b8d-b0ef-9174992e8f76 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:33.618679 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.703177 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-408226', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-406378', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2874'] for router, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:33.805548 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.db_base_plugin_common [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Allocated IP 172.20.0.2 (5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b/e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3/b7b7e1cb-cfe3-41b8-985b-73819567a003) {{(pid=98393) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:34.004858 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.018095 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Transition to ACTIVE for port object e727c6d0-b122-4b8d-b0ef-9174992e8f76 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:34.026053 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.036646 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:34.053430 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks [] for port, precommit_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.065705 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Transition to ACTIVE for port object b7b7e1cb-cfe3-41b8-985b-73819567a003 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:34.086277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Transition to ACTIVE for port object b7b7e1cb-cfe3-41b8-985b-73819567a003 will not be triggered until provisioned by entity DHCP. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:34.093822 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011'] for port, after_create {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.097715 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:34.108142 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c283b1-54d3-4e2f-a4ff-9010c1ec0741 None None] Pushing event updated for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:34.174101 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-47c283b1-54d3-4e2f-a4ff-9010c1ec0741 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:34.214696 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.252873 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b is already hosted by enough agents. {{(pid=98393) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:34.257107 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.scheduler.base_scheduler [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Resources bound (agent type, host, resource id): {{(pid=98393) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:34.259389 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Pushing event updated for resources: {'Port': ['ID=b7b7e1cb-cfe3-41b8-985b-73819567a003,revision_number=1']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:34.262171 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Received port after_create {{(pid=98393) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:34.264791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:34.271952 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.323319 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Attempting to bind port e727c6d0-b122-4b8d-b0ef-9174992e8f76 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:34.324429 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Attempting to bind port e727c6d0-b122-4b8d-b0ef-9174992e8f76 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:34.325650 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Attempting to bind port e727c6d0-b122-4b8d-b0ef-9174992e8f76 on network 62d43163-f679-4f52-9314-5c4893113cf3 {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:34.337093 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:34.337660 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Checking segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:34.338352 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.339277 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Bound using segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:34.340198 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Bound port: e727c6d0-b122-4b8d-b0ef-9174992e8f76, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:34.340642 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.371801 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Attempting to bind port b7b7e1cb-cfe3-41b8-985b-73819567a003 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:34.372383 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Attempting to bind port b7b7e1cb-cfe3-41b8-985b-73819567a003 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:34.373064 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Attempting to bind port b7b7e1cb-cfe3-41b8-985b-73819567a003 on network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:34.380515 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:34.381077 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Checking segment: {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:34.381741 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.382152 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Bound using segment: {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:34.382652 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Bound port: b7b7e1cb-cfe3-41b8-985b-73819567a003, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:34.383118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.444882 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] For port e727c6d0-b122-4b8d-b0ef-9174992e8f76, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:34.449189 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] For port e727c6d0-b122-4b8d-b0ef-9174992e8f76, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=e727c6d0-b122-4b8d-b0ef-9174992e8f76,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:34.455377 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.461053 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:34.498427 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] For port b7b7e1cb-cfe3-41b8-985b-73819567a003, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:34.501042 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Allocated IP 172.27.1.124 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/b4a335c3-877c-40a3-8964-3baff063ae66) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:34.503624 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] For port b7b7e1cb-cfe3-41b8-985b-73819567a003, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b7b7e1cb-cfe3-41b8-985b-73819567a003,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:34.510104 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.517691 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:34.556486 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:34.557600 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:34.667457 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.668035 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c283b1-54d3-4e2f-a4ff-9010c1ec0741 None None] Pushing event updated for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:34.674986 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-47c283b1-54d3-4e2f-a4ff-9010c1ec0741 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:34.683406 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Pushing event updated for resources: {'Port': ['ID=b7b7e1cb-cfe3-41b8-985b-73819567a003,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:34.688166 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:34.744236 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.807306 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:34.824307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-801adbeb-1849-41fa-9eb1-73b217a17843 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:34.885020 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:34.925938 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:34.927410 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:34.930110 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:34.991486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Pushing event updated for resources: {'Port': ['ID=b4a335c3-877c-40a3-8964-3baff063ae66,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:34.998168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:35.065124 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d0938a43-4529-4009-ac8b-6af8adc4bb26 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:35.277372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port d0938a43-4529-4009-ac8b-6af8adc4bb26 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:35.277372 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:35.480688 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:34Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:35.486882 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fda9edc0-7c8c-4e60-8c1f-a06670479107 None None] The sync data for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi is: [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:34Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:35.504330 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device e727c6d0-b122-4b8d-b0ef-9174992e8f76 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:35.618461 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:35.634629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:35.635954 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:35.775217 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:35.855460 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:35.912369 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port e727c6d0-b122-4b8d-b0ef-9174992e8f76, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=e727c6d0-b122-4b8d-b0ef-9174992e8f76,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:35.921597 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:35.927075 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:36.084832 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:36.092468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:36.151675 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-8dcb2b66-bc93-4861-a232-2c99cc7ceeaf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:18:36.175983 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-8dcb2b66-bc93-4861-a232-2c99cc7ceeaf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:18:36.186249 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-8dcb2b66-bc93-4861-a232-2c99cc7ceeaf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-714553222&fields=id&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 267 time: 0.1059144 May 25 16:18:36.277584 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:36.447944 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-952d6f30-1635-4f32-bc64-03a8eaeaa338 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:36.451224 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-952d6f30-1635-4f32-bc64-03a8eaeaa338 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:network {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:18:36.479456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a79069f1-9653-4eee-a986-2aeb9fab6f3f None None] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:18:36.483217 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-952d6f30-1635-4f32-bc64-03a8eaeaa338 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:network {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:18:36.484838 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-952d6f30-1635-4f32-bc64-03a8eaeaa338 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.2974672 May 25 16:18:36.508478 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-abf3af77-2cb9-4149-8446-f64b6634868c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/quotas/a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 375 time: 0.0117400 May 25 16:18:36.562178 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-406353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-408289'] for router, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:36.673510 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fe932e0-a2ae-4d5e-8e4d-534d7001c563 None None] Provisioning for port b7b7e1cb-cfe3-41b8-985b-73819567a003 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:36.686669 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-51b76978-2fd0-4894-95cd-4fde907aeaf9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:18:36.714016 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-51b76978-2fd0-4894-95cd-4fde907aeaf9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:18:36.716111 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-51b76978-2fd0-4894-95cd-4fde907aeaf9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1966109 May 25 16:18:36.928993 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 is scheduled to L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 with binding_index 1 {{(pid=98391) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:18:36.934393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-5b81397e-b548-43eb-88ce-1ae9dc3497ba service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:18:36.936046 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-5b81397e-b548-43eb-88ce-1ae9dc3497ba service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2061810 May 25 16:18:36.978721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device e727c6d0-b122-4b8d-b0ef-9174992e8f76 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:37.129697 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port e727c6d0-b122-4b8d-b0ef-9174992e8f76 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:37.130509 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:37.178215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:37.191526 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-da766021-968a-4219-a261-fdcc432f3db1 service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2479265 May 25 16:18:37.212953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82493045-680b-41c7-9316-a0398304b106 None None] Sync routers for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:37.228597 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:37.229286 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:37.232009 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:37.234655 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ca652abb-9011-418a-a2cf-eb60167af78e admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 4.0562418 May 25 16:18:37.237553 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 55874) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:37.412203 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-deba5297-1430-4daf-9703-3c3a701f214f service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2196209 May 25 16:18:37.482394 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:37.723325 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b7b7e1cb-cfe3-41b8-985b-73819567a003 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:37.877738 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port b7b7e1cb-cfe3-41b8-985b-73819567a003 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:37.909040 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port b7b7e1cb-cfe3-41b8-985b-73819567a003 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:37.909427 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.085274 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 3, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:38.144385 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82493045-680b-41c7-9316-a0398304b106 None None] Checking router: 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:38.144861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82493045-680b-41c7-9316-a0398304b106 None None] Updating router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 port b4a335c3-877c-40a3-8964-3baff063ae66 binding host dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:38.150217 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-da1097d3-562b-4f0d-a1c7-f143ca52ef93 req-a86b4941-d406-4d2f-8bad-9abce1363fb2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 210 time: 0.2110238 May 25 16:18:38.230575 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.243535 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.326587 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port b7b7e1cb-cfe3-41b8-985b-73819567a003, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b7b7e1cb-cfe3-41b8-985b-73819567a003,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:38.368924 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.377233 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-f1e42f80-c754-41f7-b7d8-922ff0c02900 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:38.390996 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.556369 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=b7b7e1cb-cfe3-41b8-985b-73819567a003,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:38.564235 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:38.792684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks [] for port, precommit_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.811885 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-82493045-680b-41c7-9316-a0398304b106 None None] Transition to ACTIVE for port object b4a335c3-877c-40a3-8964-3baff063ae66 will not be triggered until provisioned by entity L2. {{(pid=98393) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:38.823605 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:38.841114 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:38.901885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Allocated IP 172.20.0.1 (5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b/e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3/d2b9d0f8-735d-48b3-9d9b-0901cc802549) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:38.932168 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b7b7e1cb-cfe3-41b8-985b-73819567a003 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:39.066701 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82493045-680b-41c7-9316-a0398304b106 None None] Attempting to bind port b4a335c3-877c-40a3-8964-3baff063ae66 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:39.067596 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82493045-680b-41c7-9316-a0398304b106 None None] Attempting to bind port b4a335c3-877c-40a3-8964-3baff063ae66 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:39.068017 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82493045-680b-41c7-9316-a0398304b106 None None] Attempting to bind port b4a335c3-877c-40a3-8964-3baff063ae66 on network dd24df8c-53ac-4808-8523-828ba13af2df {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:39.090248 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82493045-680b-41c7-9316-a0398304b106 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:39.090748 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82493045-680b-41c7-9316-a0398304b106 None None] Checking segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98393) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:39.091402 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.091898 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82493045-680b-41c7-9316-a0398304b106 None None] Bound using segment: {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'} {{(pid=98393) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:39.092700 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.managers [None req-82493045-680b-41c7-9316-a0398304b106 None None] Bound port: b4a335c3-877c-40a3-8964-3baff063ae66, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9413c02f-d8ea-4438-b174-b54dd38bccfe', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df'}}] {{(pid=98393) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:39.093260 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.127447 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14c982c-30c1-4f21-b509-6d9177ffaaff None None] Pushing event updated for resources: {'Port': ['ID=b4a335c3-877c-40a3-8964-3baff063ae66,revision_number=2']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:39.131042 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d14c982c-30c1-4f21-b509-6d9177ffaaff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:39.184877 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port b7b7e1cb-cfe3-41b8-985b-73819567a003 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:39.185276 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.202689 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.234446 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Transition to ACTIVE for port object d2b9d0f8-735d-48b3-9d9b-0901cc802549 will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:39.246866 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-82493045-680b-41c7-9316-a0398304b106 None None] For port b4a335c3-877c-40a3-8964-3baff063ae66, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98393) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:39.262033 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-82493045-680b-41c7-9316-a0398304b106 None None] For port b4a335c3-877c-40a3-8964-3baff063ae66, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b4a335c3-877c-40a3-8964-3baff063ae66,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:39.271696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-82493045-680b-41c7-9316-a0398304b106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.278964 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:39.282386 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.289597 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-07b75e0f-c285-4633-a63a-10e89876c875 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:39.406781 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Pushing event updated for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:39.416392 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:39.424588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:39.425253 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:39.437630 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:39.439441 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:39.441522 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-37952a23-830b-4173-b5a8-3479a1ca80a0 req-c635a1a0-f872-48ac-9541-e00e69f5f334 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 210 time: 0.0630100 May 25 16:18:39.442785 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:39.505003 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14c982c-30c1-4f21-b509-6d9177ffaaff None None] Pushing event updated for resources: {'Port': ['ID=b4a335c3-877c-40a3-8964-3baff063ae66,revision_number=3']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:39.508692 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d14c982c-30c1-4f21-b509-6d9177ffaaff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:39.554752 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-409232'] for router_interface, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:39.669945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:39.755688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.059644 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.066026 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.076247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-b17dc45f-7853-42e0-8d04-3b8b175c4e88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:40.079348 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-b17dc45f-7853-42e0-8d04-3b8b175c4e88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.2275772 May 25 16:18:40.129442 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-f7023be5-6da1-4854-b760-6aa242fe2795 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:40.191827 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-ec88be9e-87a5-400a-a5b6-a7a69abda510 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 379 time: 0.0966191 May 25 16:18:40.196055 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581330', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-409149'] for router_interface, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.227310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'port': {'device_id': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'admin_state_up': True, 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'security_groups': ['a5265a9e-7809-4275-93e5-3ff80a9af0d2']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:40.246261 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-ad5d6c45-cb26-4a34-9276-961154c9925e None None] Provisioning for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:40.258978 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-ad5d6c45-cb26-4a34-9276-961154c9925e None None] Provisioning complete for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:40.259468 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ad5d6c45-cb26-4a34-9276-961154c9925e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.364648 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Pushing event updated for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:40.371024 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:40.378012 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:40.379406 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:40.383379 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-ad5d6c45-cb26-4a34-9276-961154c9925e None None] Port d2b9d0f8-735d-48b3-9d9b-0901cc802549 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:40.402520 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-82493045-680b-41c7-9316-a0398304b106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 3, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:40.419682 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82493045-680b-41c7-9316-a0398304b106 None None] The sync data for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi is: [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 3, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:40.535860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:40.566451 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:40.597116 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Made reservation on behalf of a899ba7d8bc0472caa53a2e65d1bd7ea for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:40.607800 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.639245 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:18:40.744367 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ab3ba9d3-80af-46f2-a6de-7ca1db3e6e9f req-8f80d563-77cf-4a1a-b1e0-882816e4caaa tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 210 time: 0.1189339 May 25 16:18:40.897555 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-93ebbdbb-4677-457d-80b9-b569dc90e675 None None] Provisioning complete for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:40.898725 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-93ebbdbb-4677-457d-80b9-b569dc90e675 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:40.935073 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.20.0.7 (0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a/659f33e2-068d-40bb-84cc-c31f8933e023/d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:40.962972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:18:40.979189 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-d678a6eb-9caa-49a7-894c-efca8f431b94 admin admin] 10.222.0.25 "PUT /v2.0/routers/5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7393084 May 25 16:18:41.040580 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-93ebbdbb-4677-457d-80b9-b569dc90e675 None None] Port d2b9d0f8-735d-48b3-9d9b-0901cc802549 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:41.439994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:41.458740 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Transition to ACTIVE for port object d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:41.492164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:41.502480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-73b64666-7ef4-4a87-b1a6-3672853afa3b tempest-VolumesNegativeTest-1175585832 tempest-VolumesNegativeTest-1175585832-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:41.618389 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:41.624537 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:41.631487 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:41.713019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:41.721222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:41.763357 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:41.764351 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:41.803837 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5846562 May 25 16:18:41.821692 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-cd563d27-1225-41f8-ba28-ef0f6d82c7a8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:18:41.822747 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-cd563d27-1225-41f8-ba28-ef0f6d82c7a8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0057609 May 25 16:18:41.893732 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Request body: {'port': {'device_id': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:41.984601 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f5c0923f-daad-4196-a8f5-0113aa3ee0dd None None] Provisioning for port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:41.999992 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-f5c0923f-daad-4196-a8f5-0113aa3ee0dd None None] Provisioning complete for port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:42.000883 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f5c0923f-daad-4196-a8f5-0113aa3ee0dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:42.080873 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-f5c0923f-daad-4196-a8f5-0113aa3ee0dd None None] Port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:42.091920 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:42.165032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c67724-800d-46d7-a58e-6f9eb00827bc req-49899467-617b-422b-937b-0c8710045e14 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:42.165674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e6c67724-800d-46d7-a58e-6f9eb00827bc req-49899467-617b-422b-937b-0c8710045e14 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:18:42.236360 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-e6c67724-800d-46d7-a58e-6f9eb00827bc req-49899467-617b-422b-937b-0c8710045e14 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:18:42.237544 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6c67724-800d-46d7-a58e-6f9eb00827bc req-49899467-617b-422b-937b-0c8710045e14 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 931 time: 0.2940946 May 25 16:18:42.396200 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6c67724-800d-46d7-a58e-6f9eb00827bc req-3166671b-9fe2-4ade-a50d-5868096cefc5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1473656 May 25 16:18:42.609165 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:18:42.618712 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:42.669863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Transition to ACTIVE for port object d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:42.683459 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:42.685905 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9d3cb71b-56b6-4c61-a57f-e64fa249cded service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:42.865394 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Sync routers for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:18:42.905630 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:42.907777 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:43.053429 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Pushing event updated for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:43.057639 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b4a335c3-877c-40a3-8964-3baff063ae66 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:43.059972 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:43.109516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Attempting to bind port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:43.110090 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Attempting to bind port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:43.110620 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Attempting to bind port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:43.117069 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:18:43.117501 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Attempting to bind port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:43.125132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:43.125132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:43.125132 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Bound using segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:43.125655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Bound port: d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:43.125778 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.266246 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:43.269655 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:43.275959 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.289036 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:43.352900 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port b4a335c3-877c-40a3-8964-3baff063ae66 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:43.371356 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port b4a335c3-877c-40a3-8964-3baff063ae66 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:43.372275 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.456265 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:43.458044 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.459790 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] 10.222.0.74 "PUT /v2.0/ports/d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 1093 time: 1.6291361 May 25 16:18:43.460429 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:18:43.488137 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Pushing event updated for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:43.503887 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:43.575280 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:43.706185 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.742882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port b4a335c3-877c-40a3-8964-3baff063ae66, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b4a335c3-877c-40a3-8964-3baff063ae66,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:43.754310 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:43.761818 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-82d116ac-2286-4534-9834-b6fd952d0f3f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:43.911807 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=b4a335c3-877c-40a3-8964-3baff063ae66,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:43.913436 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'status': 'completed', 'code': 200} May 25 16:18:43.922920 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:43.973073 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-83fd0e0f-b9ef-4271-a161-086e4b30997a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:43.974612 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-83fd0e0f-b9ef-4271-a161-086e4b30997a service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1096 time: 0.4297063 May 25 16:18:43.997837 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebf791c-dcfd-4f08-bc63-38e0033677e5 req-528ed958-5d6a-41bf-a99f-3ab3e6cd45b0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:44.004445 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aebf791c-dcfd-4f08-bc63-38e0033677e5 req-528ed958-5d6a-41bf-a99f-3ab3e6cd45b0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.1739542 May 25 16:18:44.120526 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-a8bac776-4f60-49f0-90a3-1809c295cca6 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 217 time: 0.1092548 May 25 16:18:44.206602 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-aebf791c-dcfd-4f08-bc63-38e0033677e5 req-c67e5425-c031-4a07-9017-9d9b93f8e867 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1977808 May 25 16:18:44.240610 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-3534bf95-af61-4401-bf93-5e6f031b479a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:44.243094 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-3534bf95-af61-4401-bf93-5e6f031b479a service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1103365 May 25 16:18:44.320819 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 4, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'd2b9d0f8-735d-48b3-9d9b-0901cc802549', 'name': '', 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'mac_address': 'fa:16:3e:e7:81:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_interface', 'standard_attr_id': 661, 'fixed_ips': [{'subnet_id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:38Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 2, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'subnets': [{'id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:44.329355 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Checking router: 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:18:44.330176 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Updating router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 port d2b9d0f8-735d-48b3-9d9b-0901cc802549 binding host dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:18:44.401827 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-6be5b814-ac28-4b79-8b9b-88c344e8ef81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:44.404126 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-6be5b814-ac28-4b79-8b9b-88c344e8ef81 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1530087 May 25 16:18:44.430361 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:44.788950 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-a7cfb51a-3cc4-437d-a732-375d67ce9fd2 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3771043 May 25 16:18:44.856216 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b4a335c3-877c-40a3-8964-3baff063ae66 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:45.017987 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port b4a335c3-877c-40a3-8964-3baff063ae66 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:45.018525 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:45.129499 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e9e80dee-9949-4daf-b761-c34d642b4178 req-97a58d5a-07ce-4a01-aea7-a53d53660c3a service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3327656 May 25 16:18:45.344306 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks [] for port, precommit_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:45.407989 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.provisioning_blocks [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Transition to ACTIVE for port object d2b9d0f8-735d-48b3-9d9b-0901cc802549 will not be triggered until provisioned by entity L2. {{(pid=98394) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:45.433527 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:45.440259 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-8bdb26e2-a14a-46ac-a77c-b0d6ee92e2f0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:45.653324 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4c525b-9d78-48e5-a422-b5a1000b3ea5 None None] Pushing event updated for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=3']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:45.727410 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-7a4c525b-9d78-48e5-a422-b5a1000b3ea5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:45.799924 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Attempting to bind port d2b9d0f8-735d-48b3-9d9b-0901cc802549 on host dv-cinder-786383-6-iscsi for vnic_type normal with profile {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:18:45.800192 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Attempting to bind port d2b9d0f8-735d-48b3-9d9b-0901cc802549 by drivers openvswitch,hyperv on host dv-cinder-786383-6-iscsi at level 0 using segments [{'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:18:45.800799 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Attempting to bind port d2b9d0f8-735d-48b3-9d9b-0901cc802549 on network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:18:45.807129 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Checking agent: {'id': '9c9f9b90-ace3-4f7d-8204-e3fdfa8a74fa', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786383-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 33, 31), 'started_at': datetime.datetime(2021, 5, 25, 15, 34, 1), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 18, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786383-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:18:45.807494 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Checking segment: {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98394) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:18:45.807982 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:45.808310 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Bound using segment: {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'} {{(pid=98394) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:18:45.808949 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.managers [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Bound port: d2b9d0f8-735d-48b3-9d9b-0901cc802549, host: dv-cinder-786383-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88cde3e6-4797-40ec-b8a3-f95a39764df7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 842, 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b'}}] {{(pid=98394) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:18:45.809448 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:45.863253 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94086990-65f0-48fc-ba26-a2faca401495 req-e424456e-bfb7-48fa-8283-5c0bc722d869 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:45.870861 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-e424456e-bfb7-48fa-8283-5c0bc722d869 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1096 time: 0.5867057 May 25 16:18:45.998947 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] For port d2b9d0f8-735d-48b3-9d9b-0901cc802549, host dv-cinder-786383-6-iscsi, cleared binding levels {{(pid=98394) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:18:46.011519 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.plugins.ml2.db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] For port d2b9d0f8-735d-48b3-9d9b-0901cc802549, host dv-cinder-786383-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d2b9d0f8-735d-48b3-9d9b-0901cc802549,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98394) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:18:46.028390 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron_lib.callbacks.manager [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98394) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:46.051179 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-e8cce6ff-cc39-4ed2-95e0-453ceafa44c9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:46.195235 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5326f652-1bdd-4334-9f93-492cc847de3b req-65efe897-d79d-4fe1-9506-71592cf0b0e3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:46.212273 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5326f652-1bdd-4334-9f93-492cc847de3b req-65efe897-d79d-4fe1-9506-71592cf0b0e3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.5199177 May 25 16:18:46.277195 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4c525b-9d78-48e5-a422-b5a1000b3ea5 None None] Pushing event updated for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=4']} {{(pid=98394) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:46.304377 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG oslo_concurrency.lockutils [None req-7a4c525b-9d78-48e5-a422-b5a1000b3ea5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=98394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:46.305941 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:18:46.307416 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:18:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:46.327853 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5326f652-1bdd-4334-9f93-492cc847de3b req-7906ed54-9ff5-4806-847a-aab2236c371c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1145916 May 25 16:18:46.329217 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94086990-65f0-48fc-ba26-a2faca401495 req-ddfb9cc4-01ee-44b7-9b03-da32b0e88616 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:46.330737 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-ddfb9cc4-01ee-44b7-9b03-da32b0e88616 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.4457183 May 25 16:18:46.478507 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-556f333f-b47d-47b9-9b71-d21e3540e5fc service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 217 time: 0.1278036 May 25 16:18:46.613046 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94086990-65f0-48fc-ba26-a2faca401495 req-27005848-f758-4b0c-ac64-048fa3546959 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:46.615845 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-27005848-f758-4b0c-ac64-048fa3546959 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1293802 May 25 16:18:46.695385 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:18:46.792152 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94086990-65f0-48fc-ba26-a2faca401495 req-8f6ed09b-7aa6-4378-8bdc-0235708bb6d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:46.794799 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-8f6ed09b-7aa6-4378-8bdc-0235708bb6d7 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1713676 May 25 16:18:47.067690 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-b96143da-c3b6-471d-a502-a60421f8634b service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2650099 May 25 16:18:47.188582 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 4, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'd2b9d0f8-735d-48b3-9d9b-0901cc802549', 'name': '', 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'mac_address': 'fa:16:3e:e7:81:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_interface', 'standard_attr_id': 661, 'fixed_ips': [{'subnet_id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:38Z', 'updated_at': '2021-05-25T16:18:45Z', 'revision_number': 4, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'subnets': [{'id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:18:47.193471 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2ca1f85-bb2c-43fd-bada-ed9e51c86cc3 None None] The sync data for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi is: [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:18:39Z', 'revision_number': 4, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'd2b9d0f8-735d-48b3-9d9b-0901cc802549', 'name': '', 'network_id': '5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'mac_address': 'fa:16:3e:e7:81:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_interface', 'standard_attr_id': 661, 'fixed_ips': [{'subnet_id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:38Z', 'updated_at': '2021-05-25T16:18:45Z', 'revision_number': 4, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'subnets': [{'id': 'e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:18:47.315609 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-94086990-65f0-48fc-ba26-a2faca401495 req-93b62a40-d33a-4162-bd81-5fa4d648247a service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2359023 May 25 16:18:47.721686 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271d9388-791a-4c86-8362-7a9be2afcd48 req-a779f8be-bd77-4d96-8b1b-691fd7ebc597 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:47.724290 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-271d9388-791a-4c86-8362-7a9be2afcd48 req-a779f8be-bd77-4d96-8b1b-691fd7ebc597 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.1631672 May 25 16:18:47.805186 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-271d9388-791a-4c86-8362-7a9be2afcd48 req-fc3c379d-c0f1-41c4-b8a0-cefef467a582 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0721846 May 25 16:18:49.003697 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d2b9d0f8-735d-48b3-9d9b-0901cc802549 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:49.177151 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:49.186571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:49.187545 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:49.292466 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2fdb61a-c327-4ecb-b512-e1f1651bd76d req-ea596c27-7bf8-4ab3-b687-4ea166612399 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:49.308792 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b2fdb61a-c327-4ecb-b512-e1f1651bd76d req-ea596c27-7bf8-4ab3-b687-4ea166612399 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.2286248 May 25 16:18:49.407711 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:49.420501 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b2fdb61a-c327-4ecb-b512-e1f1651bd76d req-06fbec32-ee13-4c29-a326-38d61e9e3bf1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1046743 May 25 16:18:49.470777 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] For port d2b9d0f8-735d-48b3-9d9b-0901cc802549, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d2b9d0f8-735d-48b3-9d9b-0901cc802549,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:49.487965 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:49.491290 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:49.607463 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Pushing event updated for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:49.611001 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:50.703102 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af4490df-8713-43ec-97ca-6415fbb9356f req-14e92dd0-9333-47c9-922d-e8e492b7e844 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:50.705111 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af4490df-8713-43ec-97ca-6415fbb9356f req-14e92dd0-9333-47c9-922d-e8e492b7e844 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.1157079 May 25 16:18:50.777449 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-af4490df-8713-43ec-97ca-6415fbb9356f req-e864df92-e32f-461e-92e3-28035c5ff2cb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0653927 May 25 16:18:50.851787 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d2b9d0f8-735d-48b3-9d9b-0901cc802549 up at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:50.952573 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Provisioning complete for port d2b9d0f8-735d-48b3-9d9b-0901cc802549 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:50.952573 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:52.107143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d394d576-4576-47fa-b574-df5f8dee3320 req-f7692ff3-f92a-474a-af8e-3c42265c15dc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:52.115184 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d394d576-4576-47fa-b574-df5f8dee3320 req-f7692ff3-f92a-474a-af8e-3c42265c15dc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.1283693 May 25 16:18:52.173684 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d394d576-4576-47fa-b574-df5f8dee3320 req-bcfce792-1ac0-4cc7-9705-9c130a59dbae tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545220 May 25 16:18:53.418009 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d283eb1d-ca7c-4e53-83d2-326778dedfb9 req-e2cce5fc-627c-4deb-9deb-0e278fd35eef tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:53.419606 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d283eb1d-ca7c-4e53-83d2-326778dedfb9 req-e2cce5fc-627c-4deb-9deb-0e278fd35eef tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 943 time: 0.1338506 May 25 16:18:53.480192 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d283eb1d-ca7c-4e53-83d2-326778dedfb9 req-20fb112d-f498-4b8f-ba88-10511229b8cd tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0547183 May 25 16:18:54.359627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:18:54.523146 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:54.540222 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'port_id': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'mac_address': 'fa:16:3e:61:ae:73', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 828, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:18:54.610452 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:54.629966 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:18:54.658848 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:54.665105 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:54.667917 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d14c982c-30c1-4f21-b509-6d9177ffaaff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:54.765523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:54.769753 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:54.786133 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-83a2870e-cdbc-42d6-9b2a-8c0cea35a6c2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:54.787800 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-83a2870e-cdbc-42d6-9b2a-8c0cea35a6c2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 814 time: 0.3638928 May 25 16:18:54.808497 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-4acd6314-301e-41ad-a325-ba063d71816e tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/quotas/5d2ebdea3bd843dfbaea75179867aaa5 HTTP/1.1" status: 200 len: 375 time: 0.0144787 May 25 16:18:54.817639 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff732ef-c047-4d8b-9f83-92638398be76 req-62ad222d-0fd1-4d56-a1fa-28fa7fd73b03 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:54.820029 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8ff732ef-c047-4d8b-9f83-92638398be76 req-62ad222d-0fd1-4d56-a1fa-28fa7fd73b03 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 944 time: 0.1530724 May 25 16:18:54.919642 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8ff732ef-c047-4d8b-9f83-92638398be76 req-3b3fa89f-325f-4349-9832-3bc01539582b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655186 May 25 16:18:54.944249 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d0cca970-5ff3-46ad-ba9d-8a63da48c7d1 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1231217 May 25 16:18:55.009364 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-41296c97-d178-4e1c-bd5a-e87d8a43a10a service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=98392) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:18:55.010378 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-41296c97-d178-4e1c-bd5a-e87d8a43a10a service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0540340 May 25 16:18:55.028303 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:18:55.230081 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-56180671-53fa-43ad-9c46-7eb7fa285020 service neutron] 10.222.0.25 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2128408 May 25 16:18:55.434520 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-697c747b-6091-45ef-a904-8e21b7ff733e service neutron] 10.222.0.25 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1946311 May 25 16:18:55.779071 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d90aed77-6544-4d98-9e63-e795ce5db150 req-4ec3f4ff-f5c9-428f-9670-be367a3a898d tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 210 time: 0.0893903 May 25 16:18:56.234254 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73085ce-6888-451f-8b77-ad5b12cc0b14 req-36bbf92e-14cd-4dbf-96f1-f03bc05ff18a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:56.236839 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b73085ce-6888-451f-8b77-ad5b12cc0b14 req-36bbf92e-14cd-4dbf-96f1-f03bc05ff18a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 944 time: 0.1699805 May 25 16:18:56.307064 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b73085ce-6888-451f-8b77-ad5b12cc0b14 req-565f6bbb-96a6-41a6-81c2-2ff23eda682b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0612409 May 25 16:18:56.354100 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:18:56.429096 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:56.434710 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:56.435102 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:56.561572 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:56.595374 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:18:56.608007 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:18:56.613517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:56.615896 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:56.701220 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:56.710382 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.710941 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.711625 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.712030 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.712419 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.712976 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.713495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.714030 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.714570 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.715409 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.715841 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.716292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:56.722151 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:56.832895 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'code': 200} May 25 16:18:56.991928 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-79354476-acb7-400c-8685-93b701347f50 req-6370f520-716d-4af8-b725-25e75997db34 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 210 time: 0.0548339 May 25 16:18:57.222192 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d615ca-6933-4d62-b9ac-88b5249c3b87 req-c7bb8c57-f894-4721-bbd7-a8ae9dc6c6a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:57.222864 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.74', 62388) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:18:57.224036 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0d615ca-6933-4d62-b9ac-88b5249c3b87 req-c7bb8c57-f894-4721-bbd7-a8ae9dc6c6a0 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1098 time: 0.1161242 May 25 16:18:57.271800 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a0d615ca-6933-4d62-b9ac-88b5249c3b87 req-dcd28efe-74c3-417a-b184-dd5eb2e92ede service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414975 May 25 16:18:57.605794 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff7f609-5d8b-4aa6-a271-33c7485b0fed req-1d44c9b5-0dd3-4a46-b3e2-df01faeefede tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:57.608875 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8ff7f609-5d8b-4aa6-a271-33c7485b0fed req-1d44c9b5-0dd3-4a46-b3e2-df01faeefede tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1477077 May 25 16:18:57.615650 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-b178d3db-94ad-4ad2-8568-68917f24bb37 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:57.616700 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-b178d3db-94ad-4ad2-8568-68917f24bb37 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Synchronizing usage tracker for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:network {{(pid=98391) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:18:57.651218 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-b178d3db-94ad-4ad2-8568-68917f24bb37 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Unset dirty status for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:network {{(pid=98391) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:18:57.652982 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-b178d3db-94ad-4ad2-8568-68917f24bb37 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 814 time: 0.4276254 May 25 16:18:57.676536 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'port': {'device_id': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'admin_state_up': True, 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:18:57.701350 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8ff7f609-5d8b-4aa6-a271-33c7485b0fed req-43366031-c6a8-4252-846c-653b4416901c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0785089 May 25 16:18:57.862913 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:18:57.869835 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:port and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:18:57.874781 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:18:57.884675 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:18:57.896326 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Made reservation on behalf of 5d2ebdea3bd843dfbaea75179867aaa5 for: {'port': 1} {{(pid=98391) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:18:57.903214 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:58.088247 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_common [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Allocated IP 172.20.0.14 (62d43163-f679-4f52-9314-5c4893113cf3/34f9fa10-b0a2-4008-8b3a-e7097da2d46a/f818f222-4e77-4a1a-8846-f4bb1d4ff342) {{(pid=98391) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:18:58.234896 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b7f8ec10-0e44-4a07-8901-e84c2c4cd2e2 req-c26f4f62-6011-4055-97a1-715e84e93712 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 210 time: 0.0970142 May 25 16:18:58.492780 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for port, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:58.513588 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Transition to ACTIVE for port object f818f222-4e77-4a1a-8846-f4bb1d4ff342 will not be triggered until provisioned by entity DHCP. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:18:58.549104 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:58.558858 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6b163b84-6556-47b2-a6fb-ec8a8e28d082 tempest-VolumesSnapshotTestJSON-335987120 tempest-VolumesSnapshotTestJSON-335987120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:18:58.657007 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Network 62d43163-f679-4f52-9314-5c4893113cf3 is already hosted by enough agents. {{(pid=98391) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:18:58.660770 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.base_scheduler [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources bound (agent type, host, resource id): {{(pid=98391) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:18:58.664560 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Received port after_create {{(pid=98391) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:18:58.733867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:18:58.751713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.752106 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.752491 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.752868 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.753241 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.753618 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.753982 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.754349 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.754714 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.755075 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.755437 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.755829 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:18:58.759914 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:18:58.776243 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:58.777001 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:58.836504 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-6335059e-e14c-4ba9-b612-1458f2770c1c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1672506 May 25 16:18:59.016849 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-dc3cd991-7104-419a-a352-df5aab10845b None None] Provisioning for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:18:59.029532 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-dc3cd991-7104-419a-a352-df5aab10845b None None] Provisioning complete for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:18:59.030266 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dc3cd991-7104-419a-a352-df5aab10845b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:59.034070 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609ce51c-24e7-4fe1-aedd-7f108d63c526 req-e789d625-92aa-46b5-8ec1-5c0faf38b0a1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:59.041723 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-609ce51c-24e7-4fe1-aedd-7f108d63c526 req-e789d625-92aa-46b5-8ec1-5c0faf38b0a1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1111004 May 25 16:18:59.090142 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-609ce51c-24e7-4fe1-aedd-7f108d63c526 req-f8e10d3e-818b-4c94-8438-1d754c801e8d tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474939 May 25 16:18:59.160443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-dc3cd991-7104-419a-a352-df5aab10845b None None] Port f818f222-4e77-4a1a-8846-f4bb1d4ff342 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:18:59.278344 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bf174720-9d64-42b8-9d98-d07807919b42 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:18:59.476958 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a4b55e-51f8-443b-8f62-02dfe188e32a req-ccf450d8-4237-4bf8-a80a-e73ebfcb439a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:18:59.490852 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-31a4b55e-51f8-443b-8f62-02dfe188e32a req-ccf450d8-4237-4bf8-a80a-e73ebfcb439a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.1261117 May 25 16:18:59.580911 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-31a4b55e-51f8-443b-8f62-02dfe188e32a req-34978449-021c-4096-96f4-d11428ac6740 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866024 May 25 16:19:00.321078 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d1e98f-32c8-4493-95df-e21c44b91870 req-dff4669b-d6f8-4a54-a565-2192e3c09a8e tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:00.323937 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d7d1e98f-32c8-4493-95df-e21c44b91870 req-dff4669b-d6f8-4a54-a565-2192e3c09a8e tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1058190 May 25 16:19:00.388501 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d7d1e98f-32c8-4493-95df-e21c44b91870 req-2705f034-c8b3-4e1f-90d6-e7be5c84e03c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520806 May 25 16:19:00.835808 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d99cb86-6b30-43b3-b36a-5f650320751d req-c5bc438d-81c1-44df-87d6-842f34aa4f83 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:00.837612 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0d99cb86-6b30-43b3-b36a-5f650320751d req-c5bc438d-81c1-44df-87d6-842f34aa4f83 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.1166413 May 25 16:19:00.900253 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0d99cb86-6b30-43b3-b36a-5f650320751d req-82c32460-a4b9-4c30-8c65-a539ad76e4b0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515287 May 25 16:19:01.638465 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:01.698815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4216b760-8c74-4498-bb2a-0d317e245f08 req-ea31ffe0-1815-4efa-a926-0810173854f0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:01.701819 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4216b760-8c74-4498-bb2a-0d317e245f08 req-ea31ffe0-1815-4efa-a926-0810173854f0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1687565 May 25 16:19:01.788402 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4216b760-8c74-4498-bb2a-0d317e245f08 req-1f8a2c4a-0cc3-48f4-946f-4acb040bb4e0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0767570 May 25 16:19:01.814181 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c1566bd5-8681-4080-bd72-93a49ae6c363 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:02.152187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36c84f2-f4bd-424c-8245-6e15ac24c5e3 req-33830434-139e-4074-beb5-9501b715ad31 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:02.155049 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c36c84f2-f4bd-424c-8245-6e15ac24c5e3 req-33830434-139e-4074-beb5-9501b715ad31 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.0925915 May 25 16:19:02.216640 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c36c84f2-f4bd-424c-8245-6e15ac24c5e3 req-c0bfebe4-5c17-4e30-b13b-26a6a24e3d72 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509996 May 25 16:19:02.898131 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:03.039941 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9807fed-aac5-48d6-bf10-524c1ac85cb5 req-34f159ef-8d6b-46f5-b129-d55c8cd805aa tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:03.041512 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b9807fed-aac5-48d6-bf10-524c1ac85cb5 req-34f159ef-8d6b-46f5-b129-d55c8cd805aa tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1183529 May 25 16:19:03.112089 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b9807fed-aac5-48d6-bf10-524c1ac85cb5 req-3109ae7a-9056-4a68-84d4-d88fe4ec6697 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0603352 May 25 16:19:03.530659 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592db3e3-d8e3-4c3e-9775-747cc844352d req-aab8a564-2ef3-49b9-93f5-d992284064ca tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:03.533161 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-592db3e3-d8e3-4c3e-9775-747cc844352d req-aab8a564-2ef3-49b9-93f5-d992284064ca tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.1859348 May 25 16:19:03.710937 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-592db3e3-d8e3-4c3e-9775-747cc844352d req-f9b913f3-de66-4f5a-80b7-ecf2b5674845 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1714849 May 25 16:19:04.322457 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc9cdef-55b5-4f25-94ce-2c1447f58363 req-03bcef48-45d7-454a-a149-18b93cddd5ce tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:04.324119 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcc9cdef-55b5-4f25-94ce-2c1447f58363 req-03bcef48-45d7-454a-a149-18b93cddd5ce tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.0941629 May 25 16:19:04.390823 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcc9cdef-55b5-4f25-94ce-2c1447f58363 req-d3a60fcd-e4df-4b45-9c1a-3183a3fae0d5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580862 May 25 16:19:04.603118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:04.959691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280ce45d-5722-4154-9a02-2a2dabde2d3a req-c1004ada-f254-4dec-9615-abe2c8f3bb82 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:04.962344 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-280ce45d-5722-4154-9a02-2a2dabde2d3a req-c1004ada-f254-4dec-9615-abe2c8f3bb82 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.1310577 May 25 16:19:05.017190 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-280ce45d-5722-4154-9a02-2a2dabde2d3a req-042694e1-ba5f-424a-87cb-fb7432abf6e5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443606 May 25 16:19:05.431372 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:19:05.640860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59941179-1a0b-4943-8b28-79666d28a92c req-aa1a5fea-fdf0-4047-899e-27b113afb584 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:05.642618 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-59941179-1a0b-4943-8b28-79666d28a92c req-aa1a5fea-fdf0-4047-899e-27b113afb584 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1085460 May 25 16:19:05.704706 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-59941179-1a0b-4943-8b28-79666d28a92c req-8cd02367-8d2e-4384-ad21-155a68ff8d13 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515630 May 25 16:19:06.250823 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a83d58d-4b60-4b84-bde3-ee062f6766b6 req-8d9fac17-ba68-46ef-8e8e-8f4aea741294 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:06.252826 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a83d58d-4b60-4b84-bde3-ee062f6766b6 req-8d9fac17-ba68-46ef-8e8e-8f4aea741294 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.0910800 May 25 16:19:06.314382 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:06.315427 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a83d58d-4b60-4b84-bde3-ee062f6766b6 req-fc19a237-bd12-4580-ae22-d18e16d93495 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518732 May 25 16:19:06.984910 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40f98f2-d4e3-45c6-87ee-582a37ee032a req-2fcc1e04-dccf-4f38-834e-37a4f4be0e37 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:06.986695 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b40f98f2-d4e3-45c6-87ee-582a37ee032a req-2fcc1e04-dccf-4f38-834e-37a4f4be0e37 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1157491 May 25 16:19:07.076609 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b40f98f2-d4e3-45c6-87ee-582a37ee032a req-608134ac-faef-42ed-a117-ecac04a55cc2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0751390 May 25 16:19:07.546755 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca86304e-415f-4e80-8403-702daa6f9a3c req-55eeeba7-2059-4e18-b0f0-1a2d3199f383 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:07.548396 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca86304e-415f-4e80-8403-702daa6f9a3c req-55eeeba7-2059-4e18-b0f0-1a2d3199f383 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.0906439 May 25 16:19:07.602857 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-ca86304e-415f-4e80-8403-702daa6f9a3c req-e2108229-6870-47d1-ad69-08fea51a1393 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435820 May 25 16:19:08.482717 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961fe130-ddcd-48e6-9715-81f2ec0aeb71 req-6a3ac722-9ba2-4a8c-8ad7-e4cb525f72cf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:08.484318 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-961fe130-ddcd-48e6-9715-81f2ec0aeb71 req-6a3ac722-9ba2-4a8c-8ad7-e4cb525f72cf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1796358 May 25 16:19:08.534660 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-961fe130-ddcd-48e6-9715-81f2ec0aeb71 req-e990aead-d29f-4012-a0c6-c4861909ca4b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446422 May 25 16:19:08.854935 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea7d34f-0375-4b29-bfe4-e37e1d840ea7 req-1a2853ae-5fee-4183-a093-59b0d0d8e409 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:08.856662 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4ea7d34f-0375-4b29-bfe4-e37e1d840ea7 req-1a2853ae-5fee-4183-a093-59b0d0d8e409 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.0924363 May 25 16:19:08.961628 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4ea7d34f-0375-4b29-bfe4-e37e1d840ea7 req-15dfd56f-926d-468f-a8bf-7f3966d153af tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876238 May 25 16:19:09.750609 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9fbc13b-88a6-4be3-9321-cb915cb77dc7 req-a53990af-991c-40a3-825e-43a8dda86fc1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:09.753230 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d9fbc13b-88a6-4be3-9321-cb915cb77dc7 req-a53990af-991c-40a3-825e-43a8dda86fc1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.0899913 May 25 16:19:09.809608 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d9fbc13b-88a6-4be3-9321-cb915cb77dc7 req-7f7aa5ac-bae7-4f77-a17f-e599afa8992b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491846 May 25 16:19:10.161304 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4973c392-c247-46d7-8356-a9c56cd319d3 req-584ab7f2-5c32-44ba-9771-5df71fe2e4a9 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:10.163379 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4973c392-c247-46d7-8356-a9c56cd319d3 req-584ab7f2-5c32-44ba-9771-5df71fe2e4a9 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 932 time: 0.0878067 May 25 16:19:10.220580 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4973c392-c247-46d7-8356-a9c56cd319d3 req-f56ead8b-8131-4cb4-a14c-f5b2fd2565d5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468698 May 25 16:19:10.452322 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Request body: {'port': {'device_id': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:10.577844 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.024091 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beff8996-399d-455d-9a94-a60b3a470acd req-e3887171-8412-4c8e-bcd8-a04b005ce249 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:11.025858 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-beff8996-399d-455d-9a94-a60b3a470acd req-e3887171-8412-4c8e-bcd8-a04b005ce249 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.0928214 May 25 16:19:11.040878 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f818f222-4e77-4a1a-8846-f4bb1d4ff342 {{(pid=98391) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:19:11.053083 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks [] for port, precommit_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.073797 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.provisioning_blocks [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Transition to ACTIVE for port object f818f222-4e77-4a1a-8846-f4bb1d4ff342 will not be triggered until provisioned by entity L2. {{(pid=98391) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:19:11.079168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.088999 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4cacca9c-e7b7-4df0-8dc0-122319cb1f22 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:11.093881 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-beff8996-399d-455d-9a94-a60b3a470acd req-007f1c2b-6b36-48bb-a8ba-82294e670d6a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602071 May 25 16:19:11.354346 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=2']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:11.372623 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:11.374891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Attempting to bind port f818f222-4e77-4a1a-8846-f4bb1d4ff342 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:19:11.375230 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Attempting to bind port f818f222-4e77-4a1a-8846-f4bb1d4ff342 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:19:11.375725 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Attempting to bind port f818f222-4e77-4a1a-8846-f4bb1d4ff342 on network 62d43163-f679-4f52-9314-5c4893113cf3 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:19:11.382246 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Port f818f222-4e77-4a1a-8846-f4bb1d4ff342 on network 62d43163-f679-4f52-9314-5c4893113cf3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:19:11.383429 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Attempting to bind port f818f222-4e77-4a1a-8846-f4bb1d4ff342 on network 62d43163-f679-4f52-9314-5c4893113cf3 {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:19:11.388885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 19, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:19:11.389220 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Checking segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98391) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:19:11.389594 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Bound using segment: {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'} {{(pid=98391) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:19:11.390025 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.managers [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Bound port: f818f222-4e77-4a1a-8846-f4bb1d4ff342, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f7170f64-429b-4536-8abe-e62f660fad02', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3'}}] {{(pid=98391) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:19:11.390793 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.464152 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104df789-f734-4b10-a854-a21f7cfbddb5 req-358dd977-9b0e-4fe3-9971-b5935b74cb1a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:11.467061 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-104df789-f734-4b10-a854-a21f7cfbddb5 req-358dd977-9b0e-4fe3-9971-b5935b74cb1a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1738055 May 25 16:19:11.527963 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, cleared binding levels {{(pid=98391) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:19:11.533804 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98391) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:19:11.541897 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3707013'] for port, after_update {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.550860 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4917a31d-c59e-4063-99be-d681de9d2f9f tempest-DeleteServersTestJSON-1137092984 tempest-DeleteServersTestJSON-1137092984-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:11.628249 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:11.628903 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:11.630326 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d3edd949-40ad-481a-b630-27b92816884f service neutron] 10.222.0.74 "PUT /v2.0/ports/f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 1094 time: 1.1828368 May 25 16:19:11.630871 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98391) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:19:11.657434 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-104df789-f734-4b10-a854-a21f7cfbddb5 req-ef90f28c-9a86-4939-ae94-bd9460312076 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1191864 May 25 16:19:11.666005 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=3']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:11.674891 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-d3edd949-40ad-481a-b630-27b92816884f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:11.719786 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c476cf-268f-469c-a99b-b00982906fb4 req-81063e83-1fd3-40c4-ba11-05fc8be1c920 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:11.722775 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16c476cf-268f-469c-a99b-b00982906fb4 req-81063e83-1fd3-40c4-ba11-05fc8be1c920 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 944 time: 0.2540407 May 25 16:19:11.723436 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56090) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:11.824505 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-16c476cf-268f-469c-a99b-b00982906fb4 req-16588329-a93c-42ff-b3aa-a13892c31f16 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850637 May 25 16:19:11.878282 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:19:11.894358 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-7da61373-80dd-4944-8cc1-d1e1c36b413d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:11.896094 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-7da61373-80dd-4944-8cc1-d1e1c36b413d service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1097 time: 0.1854413 May 25 16:19:12.028674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3547e25f-4a09-4887-816c-4d33a34192f5 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:12.029385 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-3547e25f-4a09-4887-816c-4d33a34192f5 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] Synchronizing usage tracker for tenant:071fa67adcc445f7a4fb235d75abef7c on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:19:12.058143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-3547e25f-4a09-4887-816c-4d33a34192f5 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] Unset dirty status for tenant:071fa67adcc445f7a4fb235d75abef7c on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:19:12.063264 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-3547e25f-4a09-4887-816c-4d33a34192f5 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1093 time: 0.3322632 May 25 16:19:12.063539 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56096) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:12.069040 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'port_id': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address': '172.20.0.7'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:12.075363 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:12.079926 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:floatingip and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:12.083018 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:12.089882 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:12.103402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:12.106185 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-a8d268b7-177d-42dd-92d1-4de9fdcc1b61 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 217 time: 0.1961534 May 25 16:19:12.200309 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-094beb1c-3ad8-471b-9ccf-65a979f4b1c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:12.203031 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-094beb1c-3ad8-471b-9ccf-65a979f4b1c5 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0890317 May 25 16:19:12.258329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:12.311626 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d154c9b3-c85e-4dfb-a63e-68c2cebf2aed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:12.313142 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-d154c9b3-c85e-4dfb-a63e-68c2cebf2aed service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1018858 May 25 16:19:12.422022 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.27.1.142 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/4a1608f7-1cbe-4873-a103-caa1b9e3473c) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:19:12.484998 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-bca228ac-d1f2-48a8-8abf-3396b3441ebf service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1621141 May 25 16:19:12.669478 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-f73cc53c-b81d-4224-9f27-f38376fce7cb req-5070cc41-a19b-4396-ace2-a9ce30802a49 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1743236 May 25 16:19:12.707532 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:12.748384 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:12.756162 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-bcff6450-e3d5-4b47-8667-40a6b7848bde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:12.823905 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:19:12.827533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:19:12.831843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:19:12.877095 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=4a1608f7-1cbe-4873-a103-caa1b9e3473c,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:12.895243 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.895662 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.896044 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.896391 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.896756 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.897154 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.898199 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.898583 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.898946 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.899306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.899775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.900294 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:19:12.906162 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:12.934540 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-bf1949a4-e5e5-475c-8578-8ca53dc87580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:12.937775 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-bf1949a4-e5e5-475c-8578-8ca53dc87580 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1097 time: 0.1401956 May 25 16:19:13.209168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-b2b9b424-1d64-4eff-91c4-7125356e6084 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.211466 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-b2b9b424-1d64-4eff-91c4-7125356e6084 service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.2667584 May 25 16:19:13.291984 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-8e805edd-a3ee-4602-8fd6-4db5608b5259 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 217 time: 0.0688329 May 25 16:19:13.324774 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-a32ff122-6f18-4172-b3cb-40a4d387f203 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3829017 May 25 16:19:13.365311 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e51e50c-15b2-4c4d-ba44-36ad5e14f15a req-a63f81ba-ea2e-4947-971d-e414d6681134 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.367502 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3e51e50c-15b2-4c4d-ba44-36ad5e14f15a req-a63f81ba-ea2e-4947-971d-e414d6681134 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 944 time: 0.3496044 May 25 16:19:13.372652 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-db81dd35-f51b-452f-bb0b-eb8b353e5364 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.374296 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-db81dd35-f51b-452f-bb0b-eb8b353e5364 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0758650 May 25 16:19:13.453081 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3e51e50c-15b2-4c4d-ba44-36ad5e14f15a req-c0ec7004-57cb-4b2b-b3b6-b91125b911c0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740044 May 25 16:19:13.518615 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-b1dce49d-8d7e-4cff-a6b3-fdf252810bf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.520220 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-b1dce49d-8d7e-4cff-a6b3-fdf252810bf9 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1366563 May 25 16:19:13.582965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11c0b3b-af19-4064-b320-09097990997e req-ab12a30f-a79d-4fd2-8731-f49e8da3f59d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.584895 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-ab12a30f-a79d-4fd2-8731-f49e8da3f59d service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1098 time: 0.1208003 May 25 16:19:13.588897 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:13.694949 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-ab4bef7e-50d1-471f-9405-c9f116f20d1e service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1644263 May 25 16:19:13.785037 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:13.846259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11c0b3b-af19-4064-b320-09097990997e req-daabde2b-01c3-4e8f-bb12-fe4e78eb7c33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:13.847913 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-daabde2b-01c3-4e8f-bb12-fe4e78eb7c33 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2385054 May 25 16:19:13.865186 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [req-cd0e8fe9-db73-4f17-8dcd-5d921ca15613 req-b88b14cb-b00c-4411-b843-91f3387d7e06 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1628327 May 25 16:19:14.053597 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-10f612ff-c150-4e26-8a7e-88db55259649 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 999 time: 0.1965604 May 25 16:19:14.167709 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11c0b3b-af19-4064-b320-09097990997e req-3334acd9-defa-4222-b022-991b1a9b8db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:14.169497 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-3334acd9-defa-4222-b022-991b1a9b8db8 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0976393 May 25 16:19:14.235925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:14.246858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:14.253082 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:14.531661 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=4a1608f7-1cbe-4873-a103-caa1b9e3473c,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:14.534626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:14.547293 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:14.633197 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11c0b3b-af19-4064-b320-09097990997e req-7d82265f-a5b9-4c78-a248-ea5c391f5318 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:14.634699 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-7d82265f-a5b9-4c78-a248-ea5c391f5318 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4495075 May 25 16:19:14.961536 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP 3e834328-ccb9-401f-896a-5282f31c7863 associated. External IP: 172.27.1.142, port: d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008. May 25 16:19:15.073022 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-688feef8-7f6b-40c8-bd38-214239c98e08 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3761113 May 25 16:19:15.177276 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27dde71-7f6f-4914-8dfc-51fb24f77df4 req-3464f6c2-c77c-43df-96ba-be384eeae58a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:15.178862 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c27dde71-7f6f-4914-8dfc-51fb24f77df4 req-3464f6c2-c77c-43df-96ba-be384eeae58a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 944 time: 0.4809799 May 25 16:19:15.331156 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c27dde71-7f6f-4914-8dfc-51fb24f77df4 req-d81bc29f-75f2-460b-bc37-1ed561016e50 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1448164 May 25 16:19:15.435994 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e11c0b3b-af19-4064-b320-09097990997e req-6f9464a7-ee45-48e6-98ae-c4b56a3863d8 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3014343 May 25 16:19:15.555873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:19:15.896626 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:19:15.907865 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:19:15.919364 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:19:15.920041 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:19:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:15.926056 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:15.990146 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.9251897 May 25 16:19:15.991293 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:19:16.051121 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'status': 'completed', 'code': 200} May 25 16:19:16.112402 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:19:16.232062 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-11d74cb8-8d54-403b-9e6c-60eda2fae6ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:16.233548 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-11d74cb8-8d54-403b-9e6c-60eda2fae6ef service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1098 time: 0.1185029 May 25 16:19:16.410017 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device f818f222-4e77-4a1a-8846-f4bb1d4ff342 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:19:16.532524 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-16025c9b-f4f6-4440-825d-877e931c01f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:16.534933 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-16025c9b-f4f6-4440-825d-877e931c01f0 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2925715 May 25 16:19:16.818115 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-88965140-f986-4e62-a53f-78a64948e11d service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 999 time: 0.2187228 May 25 16:19:16.831882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '3e834328-ccb9-401f-896a-5282f31c7863', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.142', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 665, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:61:ae:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:13Z', 'updated_at': '2021-05-25T16:19:13Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:16.839072 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:19:16.858347 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:19:16.872563 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'port_id': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'mac_address': 'fa:16:3e:d2:55:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 840, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:19:16.931312 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb06ae0e-cf4c-4c0b-82fc-e7eb4491f3c9 req-4549be6c-ae73-4261-8bee-fca35a341e70 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:16.933405 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:19:16.934163 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bb06ae0e-cf4c-4c0b-82fc-e7eb4491f3c9 req-4549be6c-ae73-4261-8bee-fca35a341e70 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 944 time: 0.3974929 May 25 16:19:16.934508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:19:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:16.991709 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-98ba3d7d-0509-4d04-8bf9-d3d8dc979e21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:16.994083 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-98ba3d7d-0509-4d04-8bf9-d3d8dc979e21 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1650569 May 25 16:19:17.109289 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bb06ae0e-cf4c-4c0b-82fc-e7eb4491f3c9 req-751355e4-1bf9-4365-ad00-ad0abc35dc5f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1656046 May 25 16:19:17.122160 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:17.155082 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-62edbac8-fe22-4e03-aea0-e99ab4a0123b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:17.157632 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-62edbac8-fe22-4e03-aea0-e99ab4a0123b service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1489756 May 25 16:19:17.334324 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f818f222-4e77-4a1a-8846-f4bb1d4ff342 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:19:17.382357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:19:17.397031 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:17.400758 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-8501e1d2-1f4a-4361-a0f1-a7841090371c service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2348747 May 25 16:19:17.403010 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-7ad609e2-f79a-44cb-8001-92b761dc62aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:17.462727 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:19:17.642323 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:17.648404 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:17.664372 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9c32ea88-a6bf-4cb6-9105-3ab1c967e64b req-b8b21e98-b5a5-4db8-a817-4cfcb04e0555 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2563713 May 25 16:19:17.791455 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:19:18.062571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '3e834328-ccb9-401f-896a-5282f31c7863', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.142', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 665, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:61:ae:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:13Z', 'updated_at': '2021-05-25T16:19:13Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:18.078431 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6351259-c73e-44ec-ab06-b57a3aed3e96 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '3e834328-ccb9-401f-896a-5282f31c7863', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.142', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 665, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:61:ae:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:13Z', 'updated_at': '2021-05-25T16:19:13Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:19:18.305173 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0a1d9c-056a-4f5d-9ec5-7b535816e74e None None] New status for floating IP 3e834328-ccb9-401f-896a-5282f31c7863: ACTIVE {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:19:18.394733 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1fb064-7589-4043-9224-fcade76c61af req-1ff541cb-3ee2-4b08-9c1e-481d3bbf3b3e tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:18.398758 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5f1fb064-7589-4043-9224-fcade76c61af req-1ff541cb-3ee2-4b08-9c1e-481d3bbf3b3e tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 945 time: 0.1474857 May 25 16:19:18.476488 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5f1fb064-7589-4043-9224-fcade76c61af req-0f158680-13fb-4d24-be16-a9e7f3d2ed40 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704362 May 25 16:19:19.691606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10039116-4921-4b83-8a23-57244e157455 req-7eed11da-5fa9-422d-ba22-b9c0f045f131 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:19.693143 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-10039116-4921-4b83-8a23-57244e157455 req-7eed11da-5fa9-422d-ba22-b9c0f045f131 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 945 time: 0.0904758 May 25 16:19:19.751830 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-10039116-4921-4b83-8a23-57244e157455 req-35c016ed-4525-40f8-ad90-651b6ec080c3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490830 May 25 16:19:20.401325 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device f818f222-4e77-4a1a-8846-f4bb1d4ff342 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:19:20.485575 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:19:20.494479 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:19:20.495135 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:20.729502 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:20.778953 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:19:20.794432 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:19:20.803376 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:20.807175 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:20.861093 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'code': 200} May 25 16:19:20.885290 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:20.889276 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:21.029151 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56912a3a-0964-4b45-b928-db71d99988e9 req-0bffb13e-8fed-4289-a4d0-ea86a032f070 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:21.031498 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-56912a3a-0964-4b45-b928-db71d99988e9 req-0bffb13e-8fed-4289-a4d0-ea86a032f070 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.1462317 May 25 16:19:21.136813 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-56912a3a-0964-4b45-b928-db71d99988e9 req-f8969ad3-8b63-49f5-8493-450891db193c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931373 May 25 16:19:21.182156 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43328d1-176e-4afa-93df-0d72927c86e0 req-531fb5aa-cc16-49d4-9c1f-d4e31fe971eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:21.183745 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b43328d1-176e-4afa-93df-0d72927c86e0 req-531fb5aa-cc16-49d4-9c1f-d4e31fe971eb service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1099 time: 0.0880873 May 25 16:19:21.232535 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b43328d1-176e-4afa-93df-0d72927c86e0 req-62c035c9-e06a-4d55-a689-59024d179b54 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394363 May 25 16:19:22.357342 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-054b2865-3c2c-4d30-89a5-5d00d95125d4 req-d1966633-24cf-48be-a840-f14da3ed391f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:22.358931 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-054b2865-3c2c-4d30-89a5-5d00d95125d4 req-d1966633-24cf-48be-a840-f14da3ed391f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.1076503 May 25 16:19:22.410727 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-054b2865-3c2c-4d30-89a5-5d00d95125d4 req-581af45d-df96-4122-a645-79719959cf69 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452232 May 25 16:19:23.625255 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f53204-94ad-4431-850a-e744b0610839 req-1aa3b45c-84a7-442a-9cd4-8fc823bea5d1 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:23.626881 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-41f53204-94ad-4431-850a-e744b0610839 req-1aa3b45c-84a7-442a-9cd4-8fc823bea5d1 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0953467 May 25 16:19:23.681442 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-41f53204-94ad-4431-850a-e744b0610839 req-68f68ebe-779d-423a-86ab-4bc5d23316fd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438881 May 25 16:19:23.929187 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417549c3-d4a4-43c6-9111-70b37c740dc9 req-0701acff-3341-470e-a809-949273b8e8cb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:23.930764 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-417549c3-d4a4-43c6-9111-70b37c740dc9 req-0701acff-3341-470e-a809-949273b8e8cb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0952046 May 25 16:19:23.984971 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-417549c3-d4a4-43c6-9111-70b37c740dc9 req-d3640294-49fc-4d29-bf7d-e594b6223c7b tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476675 May 25 16:19:24.426533 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b165a7f-4f16-45d3-8a99-bee60cad5fbd req-b6174d2d-d1fa-477d-b453-83dda844ee53 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:24.428803 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7b165a7f-4f16-45d3-8a99-bee60cad5fbd req-b6174d2d-d1fa-477d-b453-83dda844ee53 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0944059 May 25 16:19:24.477523 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7b165a7f-4f16-45d3-8a99-bee60cad5fbd req-36856d81-527c-448a-8bbc-aae96f9edabc tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428813 May 25 16:19:29.275303 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3da6c56e-7222-4b04-bd61-634a54a1261f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:31.616370 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:31.820129 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f0cc6495-7e65-4672-ab3e-26f976c1ad75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:32.904292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:34.606248 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:35.224483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b71fa0-adaf-4c76-85d5-f96b6987e4cb req-56ed969f-9478-4ba8-bff5-3600eba486c0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:35.226510 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43b71fa0-adaf-4c76-85d5-f96b6987e4cb req-56ed969f-9478-4ba8-bff5-3600eba486c0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0861783 May 25 16:19:35.278962 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-43b71fa0-adaf-4c76-85d5-f96b6987e4cb req-5983c74a-c6d5-441a-9901-438614e479fe tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462689 May 25 16:19:35.303502 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56178) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:35.456746 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a2fbfb4-aca1-497c-9837-a6791c0cd4e2 tempest-TestMinimumBasicScenario-375523995 tempest-TestMinimumBasicScenario-375523995-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:35.458336 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6a2fbfb4-aca1-497c-9837-a6791c0cd4e2 tempest-TestMinimumBasicScenario-375523995 tempest-TestMinimumBasicScenario-375523995-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1094 time: 0.1533358 May 25 16:19:35.462360 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56184) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:35.468286 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'port_id': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'fixed_ip_address': '172.20.0.14'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:35.474836 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:35.479204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:floatingip and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:35.482853 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:35.489691 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:35.501848 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:35.757485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:35.920252 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Allocated IP 172.27.1.50 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/6a7bf77d-3c72-4b31-b2af-2908cc100bd1) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:19:36.093711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:36.129485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:36.134245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:36.200083 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:19:36.203386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:19:36.207186 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:19:36.242212 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'Port': ['ID=6a7bf77d-3c72-4b31-b2af-2908cc100bd1,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:36.249247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:36.282791 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:36.693291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:36.828361 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:37.064671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:37.071680 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:37.080234 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:37.293365 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'Port': ['ID=6a7bf77d-3c72-4b31-b2af-2908cc100bd1,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:37.301858 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:37.313674 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:37.546762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Floating IP afaf5cf1-e352-40ea-b178-31668950136b associated. External IP: 172.27.1.50, port: f818f222-4e77-4a1a-8846-f4bb1d4ff342. May 25 16:19:38.037045 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Router 51108221-2082-49d6-b061-0b7c1c457d96 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:19:38.237087 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:19:38.247374 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Sync routers for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:19:38.257495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:19:38.258130 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:19:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:38.264939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.324233 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8604915 May 25 16:19:38.325068 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:19:38.328901 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56190) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:38.335184 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-656044137', 'description': 'tempest-secgroup-smoke-656044137 description', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:38.341853 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:38.346523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:38.352307 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:38.359439 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:38.372180 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.377723 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:19:38.395654 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:38.400467 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:38.403420 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:38.409370 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:38.466596 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:19:38.518652 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.525201 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.532206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017d3c04-5227-4163-b4d5-3788413b2720 req-2d27532b-09a4-48d9-abda-8e2d9fa84996 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:38.532597 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-558a20ea-6734-4140-a6f6-636df141f28c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:38.533748 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-2d27532b-09a4-48d9-abda-8e2d9fa84996 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1099 time: 0.0954278 May 25 16:19:38.581812 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9578d064-bf7e-4beb-8395-393c356bdebc,revision_number=1']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:38.585544 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.587200 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.2564383 May 25 16:19:38.587890 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-9c66162a-7cdc-4ce3-9e5a-81d51cb0acbb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:38.590388 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56198) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:38.596540 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:38.603635 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:38.608617 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:38.612640 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:38.621656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:38.652150 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.737441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017d3c04-5227-4163-b4d5-3788413b2720 req-492f7ba3-122e-43b2-b021-800dbe9f1779 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:38.738909 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-492f7ba3-122e-43b2-b021-800dbe9f1779 service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.1973505 May 25 16:19:38.780563 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.787276 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.791176 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-e9381c57-bfe7-449a-8a2d-4076e626f0c1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:38.834462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db4b03c1-d4f7-41ad-9636-8071f733e875,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:38.842304 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:38.856794 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:38.858439 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-06cc9fc8-4c4e-4ee7-89ac-1e4e70427ac4 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2669716 May 25 16:19:38.862980 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56202) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:38.884126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:38.894994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:38.903323 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:38.908372 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:38.917291 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:38.934069 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-4bfd4b5e-8283-4a74-a64f-2513b662e8c2 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 999 time: 0.1838553 May 25 16:19:38.982754 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'afaf5cf1-e352-40ea-b178-31668950136b', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'floating_ip_address': '172.27.1.50', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'port_id': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'mac_address': 'fa:16:3e:d2:55:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:36Z', 'updated_at': '2021-05-25T16:19:36Z', 'revision_number': 0, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:38.987462 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Checking router: 51108221-2082-49d6-b061-0b7c1c457d96 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:19:38.990131 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.000297 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:19:39.001443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:19:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:39.065183 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017d3c04-5227-4163-b4d5-3788413b2720 req-2e229ac0-1675-4ea2-855e-b1f83ef001c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:39.069935 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-2e229ac0-1675-4ea2-855e-b1f83ef001c6 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.1220467 May 25 16:19:39.155210 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.161441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.168996 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-398dbe5b-a1a9-4e83-9ebe-33248a101a2a tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:39.206768 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8907883-bd75-4dbc-b2d7-c89f64f4f9ae,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:39.218010 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:39.224298 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.226320 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-f40d40dd-f55c-4eec-8d04-004c426e928f tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3619227 May 25 16:19:39.230983 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56206) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:39.235584 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017d3c04-5227-4163-b4d5-3788413b2720 req-00e6f015-7593-41ca-9d4b-0ba39dc176d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:39.237421 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-00e6f015-7593-41ca-9d4b-0ba39dc176d2 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1572683 May 25 16:19:39.242359 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:39.252498 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:39.260531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:39.265863 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:39.277763 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:39.306167 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.326497 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:19:39.394062 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.400991 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.405060 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:39.449691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d425047e-19b2-404e-b310-627fbad07386,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:39.455330 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:39.466328 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.471898 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56210) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:39.474148 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-13930e81-8319-479c-b338-94e061a45fdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2405066 May 25 16:19:39.497803 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:39.512066 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-8bfa8094-493c-41a2-9600-65c74a49fb12 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2659276 May 25 16:19:39.513758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:39.520593 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:39.526849 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:39.567530 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:39.665229 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.752550 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-017d3c04-5227-4163-b4d5-3788413b2720 req-b9e80137-a4ad-412e-897c-67402f482b29 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2206900 May 25 16:19:39.786554 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.792153 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.794576 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:39.827734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f11b34a9-09a1-49fd-b952-334b48492a89,revision_number=0']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:39.832164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:39.847408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.849998 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7be450c6-ae56-404b-9b21-a5ae9e035113 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3744824 May 25 16:19:39.854867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56214) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:39.864212 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:39.873896 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:39.879758 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:39.883713 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:39.891993 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:39.907590 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.securitygroups_db [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Project 5d2ebdea3bd843dfbaea75179867aaa5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 16:19:39.914748 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:39.986357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'afaf5cf1-e352-40ea-b178-31668950136b', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'floating_ip_address': '172.27.1.50', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'port_id': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'mac_address': 'fa:16:3e:d2:55:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:36Z', 'updated_at': '2021-05-25T16:19:36Z', 'revision_number': 0, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:19:39.991267 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8eedace-94db-4fbe-a09b-d2fdade1df6f None None] The sync data for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi is: [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': 'afaf5cf1-e352-40ea-b178-31668950136b', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'floating_ip_address': '172.27.1.50', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'port_id': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 667, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'mac_address': 'fa:16:3e:d2:55:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:19:36Z', 'updated_at': '2021-05-25T16:19:36Z', 'revision_number': 0, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:19:40.008856 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.014803 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.018735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:40.064739 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=502993e7-7c14-47df-ad59-3fb37a26e653,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:40.070571 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:40.083658 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.088254 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-9226d41b-1f65-46fd-9ec7-b76fa1bace03 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2287331 May 25 16:19:40.091263 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56218) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:19:40.097338 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.v2.base [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'security_group_rule': {'security_group_id': '9578d064-bf7e-4beb-8395-393c356bdebc', 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98391) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:40.107657 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:19:40.114828 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Usage tracker for resource:security_group_rule and tenant:5d2ebdea3bd843dfbaea75179867aaa5 is out of sync, need to count used quota {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:19:40.119343 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.quota.resource [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98391) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:19:40.127241 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.quota.driver [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98391) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:19:40.149561 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.db.securitygroups_db [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Project 5d2ebdea3bd843dfbaea75179867aaa5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 16:19:40.156977 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.252607 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daed8f50-3fde-4c81-ae2e-ec7859e437de None None] New status for floating IP afaf5cf1-e352-40ea-b178-31668950136b: ACTIVE {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:19:40.269285 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.275240 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460649'] for security_group_rule, after_create {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.278877 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:40.321656 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ab0a3ea6-ba6b-4454-bab8-fc5bc1b91900,revision_number=0']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:40.326379 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:40.339050 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:40.341103 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b82695e1-8a55-455e-9bf3-bb5b3abcbe43 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2484543 May 25 16:19:40.507906 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-e65760d5-9d20-465e-bd0e-be1122f852d0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-656044137&fields=id&tenant_id=5d2ebdea3bd843dfbaea75179867aaa5 HTTP/1.1" status: 200 len: 267 time: 0.0733690 May 25 16:19:40.616573 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-bf519ec1-8938-47b2-8033-9e0ee637fd9c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:40.618193 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-bf519ec1-8938-47b2-8033-9e0ee637fd9c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.1011541 May 25 16:19:40.636618 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'port': {'security_groups': ['e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d', '9578d064-bf7e-4beb-8395-393c356bdebc']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:19:40.886129 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:41.227059 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:19:41.258615 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:41.266480 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:41.274249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d195fa3f-b8c0-4293-bc48-764dae74570c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:19:41.311621 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:19:41.350966 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:41.351906 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:41.353514 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fab5a308-23a4-4b77-8778-06d6e399b82b req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "PUT /v2.0/ports/f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 982 time: 0.7231183 May 25 16:19:41.354136 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:19:41.385204 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=6']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:19:41.390185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:19:41.465630 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:19:41.534169 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:19:41.714285 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be61dd5-13da-438b-848f-dcfb7cc1da77 req-878ef1b7-15c0-4e5a-b46e-fc7f16e66de3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:41.717302 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0be61dd5-13da-438b-848f-dcfb7cc1da77 req-878ef1b7-15c0-4e5a-b46e-fc7f16e66de3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.1895444 May 25 16:19:41.719915 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17230f-b999-4558-8ad1-aa67259c572b req-734f7571-d49a-4974-85a6-4fcdecb3eb0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:41.721986 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-734f7571-d49a-4974-85a6-4fcdecb3eb0e service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1138 time: 0.1440983 May 25 16:19:41.776854 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-b580a52d-a8ad-4088-b54f-7219d6563abb None None] Provisioning complete for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:19:41.777492 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-b580a52d-a8ad-4088-b54f-7219d6563abb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:41.885850 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0be61dd5-13da-438b-848f-dcfb7cc1da77 req-a3a87fd0-3a6b-4173-886c-6e496ebb414d tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1617239 May 25 16:19:41.948232 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17230f-b999-4558-8ad1-aa67259c572b req-d7ff1b29-1158-49b3-8b97-5a89c6b2eb1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:41.950116 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-d7ff1b29-1158-49b3-8b97-5a89c6b2eb1a service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.2059739 May 25 16:19:42.077925 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-5b99d276-e2f1-4c28-a413-4f6292773182 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 1001 time: 0.1145570 May 25 16:19:42.156742 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17230f-b999-4558-8ad1-aa67259c572b req-4e12d22b-eaac-4eee-8f89-729a619724fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:42.159353 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-4e12d22b-eaac-4eee-8f89-729a619724fe service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0736547 May 25 16:19:42.293290 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17230f-b999-4558-8ad1-aa67259c572b req-f5370469-7c85-4a35-a444-3779ed7fcfac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:42.295298 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-f5370469-7c85-4a35-a444-3779ed7fcfac service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1290143 May 25 16:19:42.432408 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:19:42.489418 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-9e7b2841-fd3a-48fe-acb5-4b63f7570415 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1864517 May 25 16:19:42.733161 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1d17230f-b999-4558-8ad1-aa67259c572b req-3a271e3d-760a-4abc-b4e0-5b0c36a55827 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2370269 May 25 16:19:59.274588 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-a4026fd0-be04-4760-97b7-def9e8dbca15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:19:59.388285 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc86ac9-b1d1-45f6-9837-b78c3a282fd4 req-3ecd23f2-2c34-4b8a-80ab-b63ea4e6f6ac tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:59.389887 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bbc86ac9-b1d1-45f6-9837-b78c3a282fd4 req-3ecd23f2-2c34-4b8a-80ab-b63ea4e6f6ac tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.1620212 May 25 16:19:59.398827 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09043a68-6e8b-4008-a111-032fff852325 req-e95cd437-7a43-4523-8943-25379d0c33ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:59.400388 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-e95cd437-7a43-4523-8943-25379d0c33ef service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1138 time: 0.1217606 May 25 16:19:59.529634 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bbc86ac9-b1d1-45f6-9837-b78c3a282fd4 req-ace1a580-8f99-4bc5-9054-b4d685f2bd6d tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1280746 May 25 16:19:59.585646 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09043a68-6e8b-4008-a111-032fff852325 req-a74d6808-e60e-4ce0-a361-9e97b3a175a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:59.587120 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-a74d6808-e60e-4ce0-a361-9e97b3a175a3 service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.1713383 May 25 16:19:59.804345 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-176a0a9f-6f36-4860-8c4a-8f145ae11bac service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 1001 time: 0.2094123 May 25 16:19:59.873249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09043a68-6e8b-4008-a111-032fff852325 req-2ed9507e-59a5-4237-8b63-323ee7e1de65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:59.875020 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-2ed9507e-59a5-4237-8b63-323ee7e1de65 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0637958 May 25 16:19:59.965860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09043a68-6e8b-4008-a111-032fff852325 req-944aa4eb-bb8c-4b53-b0bc-88faa41a3d40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:19:59.967371 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-944aa4eb-bb8c-4b53-b0bc-88faa41a3d40 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0844970 May 25 16:20:00.116167 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-4a425560-c3db-4434-b0ed-9bf1e64384d6 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1390436 May 25 16:20:00.267420 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-09043a68-6e8b-4008-a111-032fff852325 req-f3e8ee0f-5c1f-403f-a7fb-6d49115dde03 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1447003 May 25 16:20:00.747513 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a863150-6267-49ef-b7d8-27b7a9cd1692 req-4d2a319e-0f61-478a-bce2-4d996821a451 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:00.749142 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5a863150-6267-49ef-b7d8-27b7a9cd1692 req-4d2a319e-0f61-478a-bce2-4d996821a451 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0943837 May 25 16:20:00.824489 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5a863150-6267-49ef-b7d8-27b7a9cd1692 req-efb90397-ef33-492d-84fd-69559db22111 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0634682 May 25 16:20:01.613799 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:01.806960 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-76678c50-bc37-4c8f-9986-c3638272d12f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:02.063452 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6df4a1-8efd-40eb-9150-1b238bea6f28 req-45c57ae7-3e9d-4f27-8480-90b56e475dff tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:02.066229 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b6df4a1-8efd-40eb-9150-1b238bea6f28 req-45c57ae7-3e9d-4f27-8480-90b56e475dff tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.1262896 May 25 16:20:02.121818 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-2b6df4a1-8efd-40eb-9150-1b238bea6f28 req-5b63fa55-b5d8-4e02-95a7-b70ee034d397 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0494869 May 25 16:20:02.899826 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:03.323860 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90abc893-6e5a-47d8-955f-ec1fc6d93c27 req-b001f159-c3bb-473a-8cd1-5b1f08b84de8 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:03.325384 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-90abc893-6e5a-47d8-955f-ec1fc6d93c27 req-b001f159-c3bb-473a-8cd1-5b1f08b84de8 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0889456 May 25 16:20:03.384577 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-90abc893-6e5a-47d8-955f-ec1fc6d93c27 req-064dd3dd-1d54-4630-b177-7b743ccb7114 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0521441 May 25 16:20:04.590488 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b5349b-345e-4f73-a3d2-d5f18432cfed req-f170906d-e2be-4ad3-875b-d8480e715436 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:04.592250 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b7b5349b-345e-4f73-a3d2-d5f18432cfed req-f170906d-e2be-4ad3-875b-d8480e715436 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0914569 May 25 16:20:04.615498 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:04.659963 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b7b5349b-345e-4f73-a3d2-d5f18432cfed req-279f9444-4226-487e-9c00-c6a67facbcd7 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0560460 May 25 16:20:05.864790 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e53a94a-3aa6-4581-9640-9533c1a06496 req-872a1894-0395-4fdc-83b0-f9dabd68af2c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:05.866467 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5e53a94a-3aa6-4581-9640-9533c1a06496 req-872a1894-0395-4fdc-83b0-f9dabd68af2c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0903659 May 25 16:20:05.918683 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5e53a94a-3aa6-4581-9640-9533c1a06496 req-c8abe1be-19b1-48df-a299-59393497a497 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0459557 May 25 16:20:06.296456 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:07.119939 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2f6e41-f2fe-4fdb-926b-e14615115555 req-3528032d-9435-4f64-8fe2-5d22b2e3406c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:07.121614 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6a2f6e41-f2fe-4fdb-926b-e14615115555 req-3528032d-9435-4f64-8fe2-5d22b2e3406c tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0912523 May 25 16:20:07.185593 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6a2f6e41-f2fe-4fdb-926b-e14615115555 req-5ea84f79-83d2-470e-82b9-828ad90782e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0577571 May 25 16:20:08.385836 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95ae525-773b-47c2-abae-075326df147f req-8282a8aa-8f69-44a1-80ea-c070c91e70e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:08.387384 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c95ae525-773b-47c2-abae-075326df147f req-8282a8aa-8f69-44a1-80ea-c070c91e70e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0866263 May 25 16:20:08.440732 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c95ae525-773b-47c2-abae-075326df147f req-7f741d2d-43cb-4c30-ba79-b2c9b60b42ec tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0471621 May 25 16:20:09.642271 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de1e4b9-6c79-4e1a-a425-837738f98475 req-bc0d5ba9-3ac6-4ffb-8f8c-638f65896cd3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:09.643922 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4de1e4b9-6c79-4e1a-a425-837738f98475 req-bc0d5ba9-3ac6-4ffb-8f8c-638f65896cd3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0878365 May 25 16:20:09.704486 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4de1e4b9-6c79-4e1a-a425-837738f98475 req-5b80cc32-ceae-4e57-a568-306d8cedf3cb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0516856 May 25 16:20:10.910289 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14bd315d-41b2-429b-bc81-5dc39af94309 req-9e3cd145-b72f-4690-b07a-fb50a51fd0c3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:10.911776 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-14bd315d-41b2-429b-bc81-5dc39af94309 req-9e3cd145-b72f-4690-b07a-fb50a51fd0c3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0896106 May 25 16:20:10.965487 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-14bd315d-41b2-429b-bc81-5dc39af94309 req-2da6ff2d-0540-4692-9bc2-60c97ad57f9b tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0464199 May 25 16:20:12.172345 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14e8596-646e-46a7-baed-1ea6e5a595d7 req-a483cc36-dac8-4766-8bf7-c4a41443df40 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:12.174623 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e14e8596-646e-46a7-baed-1ea6e5a595d7 req-a483cc36-dac8-4766-8bf7-c4a41443df40 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0911584 May 25 16:20:12.227913 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e14e8596-646e-46a7-baed-1ea6e5a595d7 req-4b295ebd-d088-4ab4-b9e5-1c3f7e8e9a59 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=9578d064-bf7e-4beb-8395-393c356bdebc&id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0466590 May 25 16:20:14.837931 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-6af24fd2-9034-4787-b3d8-11417d7bee6e service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0994349 May 25 16:20:15.073737 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-9e968674-74f1-48b5-8f5a-dc47a4aadcd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:15.076664 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-9e968674-74f1-48b5-8f5a-dc47a4aadcd4 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 1098 time: 0.1337271 May 25 16:20:15.375793 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-b8ea6a2c-b504-4cef-add5-64127e8391f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:15.377165 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-b8ea6a2c-b504-4cef-add5-64127e8391f1 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2780993 May 25 16:20:15.500145 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-9800ad37-ba2f-4866-9b59-de148bf1b27c service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 200 len: 1001 time: 0.1153829 May 25 16:20:15.627318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-af0b6810-d9cc-4cc8-ad59-6e79e836ea7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:15.629956 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-af0b6810-d9cc-4cc8-ad59-6e79e836ea7b service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1171834 May 25 16:20:15.746325 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-181afb8a-1121-4ee1-b00f-dea3f7895318 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:15.749000 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-181afb8a-1121-4ee1-b00f-dea3f7895318 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1118340 May 25 16:20:15.947399 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-367951ee-5cf6-4d45-96f3-6b23dee32584 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1880856 May 25 16:20:16.176350 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-171834b5-34a1-4bbd-82e1-0293010f1140 req-5725dbae-47ae-425a-ba56-05e65cad66de service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2217216 May 25 16:20:19.433150 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:20:29.269631 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2934c691-ba23-486e-aade-99abae7917d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:31.619815 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:31.809446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2f814ebf-d0c0-4b61-93d4-1325be4d8ac1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:32.902708 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:34.624520 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:36.310721 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:44.893712 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-bf2c1157-4099-494f-8565-bce93404bf16 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-656044137&fields=id&tenant_id=5d2ebdea3bd843dfbaea75179867aaa5 HTTP/1.1" status: 200 len: 267 time: 0.0428007 May 25 16:20:44.985982 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-52a6ce2d-c257-44b8-ba64-c950caa1acdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:44.987417 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-52a6ce2d-c257-44b8-ba64-c950caa1acdd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 985 time: 0.0878718 May 25 16:20:44.998705 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Request body: {'port': {'security_groups': ['e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:20:45.129606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.389383 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:20:45.416046 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.421878 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.428844 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d0582f30-f38a-428c-91f4-3fb9f2c43de9 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:20:45.459057 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:20:45.502592 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:45.503261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.504880 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0de8744d-7679-4e26-945e-6345a11c26a0 req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "PUT /v2.0/ports/f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 943 time: 0.5110078 May 25 16:20:45.505470 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:20:45.516104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56272) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:20:45.561949 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event updated for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=7']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:20:45.583758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.584657 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.585041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.585407 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.585982 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.586622 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.587180 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.587748 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.588282 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.588797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.589336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.589881 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:20:45.598169 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4d91ddfc-5f77-4808-89e6-b53823fd24e2 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:20:45.625235 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.638009 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:20:45.669359 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.707242 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:20:45.804350 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-d416a5bc-81bc-4880-9975-3435258dd555 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:45.806180 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-d416a5bc-81bc-4880-9975-3435258dd555 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1099 time: 0.1149063 May 25 16:20:45.904831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.912321 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-5e33350c-b4cb-4093-aa8f-f3ad627face2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:20:45.934171 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9578d064-bf7e-4beb-8395-393c356bdebc,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:20:45.939512 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:20:45.952014 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:45.953177 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a28cf049-3872-49f2-a2b5-2dc7b56535e3 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "DELETE /v2.0/security-groups/9578d064-bf7e-4beb-8395-393c356bdebc HTTP/1.1" status: 204 len: 168 time: 0.4361210 May 25 16:20:45.956780 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56276) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:20:46.001395 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-5f20dded-5349-459f-9fa1-eea9ed066901 None None] Provisioning complete for port f818f222-4e77-4a1a-8846-f4bb1d4ff342 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:20:46.001395 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5f20dded-5349-459f-9fa1-eea9ed066901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:46.183643 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-b90533e0-4f3f-475e-8332-57fe9e0f32f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:46.185280 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-b90533e0-4f3f-475e-8332-57fe9e0f32f0 service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.3722792 May 25 16:20:46.386880 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-073bc3b5-5483-4c1d-8543-33ff3f826fb6 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 1001 time: 0.1915765 May 25 16:20:46.493727 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-1ec1f721-55c0-422a-ad27-b96eadde651b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:46.495225 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-1ec1f721-55c0-422a-ad27-b96eadde651b service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0813465 May 25 16:20:46.564368 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Deleting port 6a7bf77d-3c72-4b31-b2af-2908cc100bd1 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:20:46.564733 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:46.685527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-96fc1cea-5cf5-4fbc-9e41-e0213d7c269a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:46.687111 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-96fc1cea-5cf5-4fbc-9e41-e0213d7c269a service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1833384 May 25 16:20:46.789758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:46.790538 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:46.995545 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Calling delete_port for 6a7bf77d-3c72-4b31-b2af-2908cc100bd1 owned by network:floatingip {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:20:47.062915 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-57716c69-c234-45dd-8519-4c923e452c34 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3661563 May 25 16:20:47.235714 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0e6b342e-6b27-47bd-8d9a-cd04e2f516e1 req-146daca2-e479-4684-b060-883cfbebd1da service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1630754 May 25 16:20:47.311620 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:47.316261 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-c48a8db3-f419-4b4b-96c8-037dbb5d3a71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:20:47.372998 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event deleted for resources: {'Port': ['ID=6a7bf77d-3c72-4b31-b2af-2908cc100bd1,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:20:47.408989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:20:47.472513 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks [] for floatingip, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:47.472873 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Floating IP afaf5cf1-e352-40ea-b178-31668950136b disassociated (deleted). External IP: 172.27.1.50, port: f818f222-4e77-4a1a-8846-f4bb1d4ff342. May 25 16:20:47.995396 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Router 51108221-2082-49d6-b061-0b7c1c457d96 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:20:48.203479 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:20:48.215922 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Sync routers for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:20:48.221716 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:48.231423 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:20:48.232469 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:20:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:20:48.285273 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "DELETE /v2.0/floatingips/afaf5cf1-e352-40ea-b178-31668950136b HTTP/1.1" status: 204 len: 168 time: 2.3274436 May 25 16:20:48.285963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:20:48.365839 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:20:48.508038 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-d73c4e58-e240-4398-8fa9-dd154575c373 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:48.510394 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-d73c4e58-e240-4398-8fa9-dd154575c373 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 1099 time: 0.0911872 May 25 16:20:48.567605 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:20:48.694157 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-b83aecfc-de69-4a85-9811-f8804c3b0ca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:48.696062 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-b83aecfc-de69-4a85-9811-f8804c3b0ca6 service neutron] 10.222.0.74 "GET /v2.0/networks?id=62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 200 len: 915 time: 0.1791763 May 25 16:20:48.774254 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-e5bf104f-40bc-463a-8100-99f9e86c0414 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 200 len: 217 time: 0.0708971 May 25 16:20:48.846231 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-3c7ec9b8-d434-4501-825e-8eb0a810ea5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:48.847674 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-3c7ec9b8-d434-4501-825e-8eb0a810ea5f service neutron] 10.222.0.74 "GET /v2.0/subnets?id=34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 200 len: 853 time: 0.0658302 May 25 16:20:48.945508 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-7e32225d-1bda-46b7-8946-7386e03da4cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:48.947457 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-7e32225d-1bda-46b7-8946-7386e03da4cd service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=62d43163-f679-4f52-9314-5c4893113cf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0923846 May 25 16:20:49.057860 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:20:49.062875 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Checking router: 51108221-2082-49d6-b061-0b7c1c457d96 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:20:49.072882 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:20:49.073530 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:20:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:20:49.205135 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-d046e813-c294-4704-bb73-9a2b9ca50078 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2402177 May 25 16:20:49.275363 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:20:49.358843 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dbd7c2ef-6ba7-44ab-9967-5e00ff05eef1 req-7a2bb45d-ed76-47dc-90ab-0646d25dc8d5 service neutron] 10.222.0.74 "GET /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1466260 May 25 16:20:49.708306 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:20:49.713398 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-285d6fbf-a130-4837-a3e8-6e5fd9befec7 None None] The sync data for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi is: [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:18:29Z', 'revision_number': 4, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': 'e727c6d0-b122-4b8d-b0ef-9174992e8f76', 'name': '', 'network_id': '62d43163-f679-4f52-9314-5c4893113cf3', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'mac_address': 'fa:16:3e:2f:75:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_interface', 'standard_attr_id': 649, 'fixed_ips': [{'subnet_id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:28Z', 'updated_at': '2021-05-25T16:18:35Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'subnets': [{'id': '34f9fa10-b0a2-4008-8b3a-e7097da2d46a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:20:49.951352 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efce829b-019f-4ccb-b16f-97f0d7e9214b None None] New status for floating IP afaf5cf1-e352-40ea-b178-31668950136b: DOWN {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:20:52.108411 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaac516-6e72-4a5a-9688-ff124e414323 req-44213d4b-a498-42d0-b943-9151db9580fd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:52.109178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-baaac516-6e72-4a5a-9688-ff124e414323 req-44213d4b-a498-42d0-b943-9151db9580fd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Synchronizing usage tracker for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:20:52.128728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-baaac516-6e72-4a5a-9688-ff124e414323 req-44213d4b-a498-42d0-b943-9151db9580fd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Unset dirty status for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:20:52.130021 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-baaac516-6e72-4a5a-9688-ff124e414323 req-44213d4b-a498-42d0-b943-9151db9580fd tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.1047051 May 25 16:20:52.182724 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-baaac516-6e72-4a5a-9688-ff124e414323 req-27b4b6f6-9fa5-4748-b7f7-c5e0c7076b28 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Synchronizing usage tracker for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:security_group {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:20:52.202222 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-baaac516-6e72-4a5a-9688-ff124e414323 req-27b4b6f6-9fa5-4748-b7f7-c5e0c7076b28 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Unset dirty status for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:security_group {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:20:52.203494 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-baaac516-6e72-4a5a-9688-ff124e414323 req-27b4b6f6-9fa5-4748-b7f7-c5e0c7076b28 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676422 May 25 16:20:53.418546 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad1a37c-26d9-4c52-9255-bc8aad3e469b req-6d8209d9-93a5-4545-af2d-de00d819cd69 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:53.420341 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dad1a37c-26d9-4c52-9255-bc8aad3e469b req-6d8209d9-93a5-4545-af2d-de00d819cd69 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0928741 May 25 16:20:53.483230 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-dad1a37c-26d9-4c52-9255-bc8aad3e469b req-e721d8e7-c57f-44bf-a6bb-394de7db4ecc tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514481 May 25 16:20:54.064980 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-b285d26e-9b24-435c-abf8-d6312c936940 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:54.066562 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-b285d26e-9b24-435c-abf8-d6312c936940 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.74 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.0874178 May 25 16:20:54.220169 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Deleting port f818f222-4e77-4a1a-8846-f4bb1d4ff342 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:20:54.220508 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:54.477267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] For port f818f222-4e77-4a1a-8846-f4bb1d4ff342, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f818f222-4e77-4a1a-8846-f4bb1d4ff342,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:20:54.477987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:54.644142 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Calling delete_port for f818f222-4e77-4a1a-8846-f4bb1d4ff342 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:20:54.720985 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bea4b9a-b3f6-49c9-93f9-f0a10293fb46 req-bbce53e9-6510-4f3e-8576-c84c1426179a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:20:54.722561 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6bea4b9a-b3f6-49c9-93f9-f0a10293fb46 req-bbce53e9-6510-4f3e-8576-c84c1426179a tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 946 time: 0.1188502 May 25 16:20:54.817367 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6bea4b9a-b3f6-49c9-93f9-f0a10293fb46 req-fa2155fe-a4e2-417e-8bf0-5364c6de3bd9 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/security-groups?id=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864060 May 25 16:20:54.845173 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:54.852441 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-405f36d5-ca8a-4446-88ca-c8e16de3818d tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:20:54.889124 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['f818f222-4e77-4a1a-8846-f4bb1d4ff342'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:20:54.905726 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Pushing event deleted for resources: {'Port': ['ID=f818f222-4e77-4a1a-8846-f4bb1d4ff342,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:20:54.909094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:20:54.987517 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] No DVR routers for this DVR port f818f222-4e77-4a1a-8846-f4bb1d4ff342 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:20:54.990249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:54.993177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'name': 'network-vif-deleted', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:20:55.011762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1a3a78eb-9b20-4c0d-baa4-67d1a3b61cbb req-278ff1bd-f0e0-4eb3-8fd5-525deead21b5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.74 "DELETE /v2.0/ports/f818f222-4e77-4a1a-8846-f4bb1d4ff342 HTTP/1.1" status: 204 len: 173 time: 0.9373741 May 25 16:20:55.045137 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0e74020d-b302-4b18-af10-5c938bb8c5bb', 'name': 'network-vif-deleted', 'tag': 'f818f222-4e77-4a1a-8846-f4bb1d4ff342', 'status': 'completed', 'code': 200} May 25 16:20:56.025164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-1b69e129-09f0-4be4-8573-101aeeabb136 req-4a3e5e8d-30a4-4b06-b28c-925c97256df5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Synchronizing usage tracker for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:20:56.042461 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-1b69e129-09f0-4be4-8573-101aeeabb136 req-4a3e5e8d-30a4-4b06-b28c-925c97256df5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Unset dirty status for tenant:5d2ebdea3bd843dfbaea75179867aaa5 on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:20:56.044184 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b69e129-09f0-4be4-8573-101aeeabb136 req-4a3e5e8d-30a4-4b06-b28c-925c97256df5 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] 10.222.0.25 "GET /v2.0/ports?device_id=0e74020d-b302-4b18-af10-5c938bb8c5bb HTTP/1.1" status: 200 len: 210 time: 0.0698988 May 25 16:20:56.433166 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:20:56.895900 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device f818f222-4e77-4a1a-8846-f4bb1d4ff342 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:20:56.934198 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: f818f222-4e77-4a1a-8846-f4bb1d4ff342 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:20:56.934544 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device f818f222-4e77-4a1a-8846-f4bb1d4ff342 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:20:57.826376 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56362) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:20:58.424306 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:59.094569 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Deleting port e727c6d0-b122-4b8d-b0ef-9174992e8f76 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:20:59.095434 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:59.234843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] For port e727c6d0-b122-4b8d-b0ef-9174992e8f76, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=e727c6d0-b122-4b8d-b0ef-9174992e8f76,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:20:59.235090 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:59.268734 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-89398b86-f0fb-4bac-a61c-9ac1776273ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:59.374086 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Calling delete_port for e727c6d0-b122-4b8d-b0ef-9174992e8f76 owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:20:59.795777 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:20:59.800153 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:20:59.848784 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Pushing event deleted for resources: {'Port': ['ID=e727c6d0-b122-4b8d-b0ef-9174992e8f76,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:20:59.887591 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:00.166605 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:00.689958 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Router 51108221-2082-49d6-b061-0b7c1c457d96 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:21:00.886244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:21:00.896938 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Sync routers for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:21:00.908688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56368) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:00.909379 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] 10.222.0.25 "PUT /v2.0/routers/51108221-2082-49d6-b061-0b7c1c457d96/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0808382 May 25 16:21:00.932111 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:00.932927 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:20:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:01.163173 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:01.286104 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks [] for router, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.511128 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:20:59Z', 'revision_number': 5, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port': {'id': 'd0938a43-4529-4009-ac8b-6af8adc4bb26', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:db:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51108221-2082-49d6-b061-0b7c1c457d96', 'device_owner': 'network:router_gateway', 'standard_attr_id': 648, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:24Z', 'updated_at': '2021-05-25T16:18:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:01.515530 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Checking router: 51108221-2082-49d6-b061-0b7c1c457d96 for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:21:01.525242 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Routers {'51108221-2082-49d6-b061-0b7c1c457d96'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:01.525862 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:20:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['51108221-2082-49d6-b061-0b7c1c457d96'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:01.545950 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.579310 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b2fdc49-3851-4e5f-9570-aba3eee3df36 req-82aecf6f-0747-42e8-9ecd-a13d6251449f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:01.582116 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0b2fdc49-3851-4e5f-9570-aba3eee3df36 req-82aecf6f-0747-42e8-9ecd-a13d6251449f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1478219 May 25 16:21:01.640295 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Deleting port d0938a43-4529-4009-ac8b-6af8adc4bb26 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:01.640632 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.672853 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0b2fdc49-3851-4e5f-9570-aba3eee3df36 req-6348d52b-45f3-4efb-a89b-48cb785401ac tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0821185 May 25 16:21:01.689669 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.720027 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] Set router 51108221-2082-49d6-b061-0b7c1c457d96 gateway port host: None {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:01.779168 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] For port d0938a43-4529-4009-ac8b-6af8adc4bb26, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d0938a43-4529-4009-ac8b-6af8adc4bb26,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:01.779747 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.837298 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:21:01Z', 'revision_number': 6, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:01.847571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a415e00e-ac8e-4572-972c-6778bec409c2 None None] The sync data for ids ['51108221-2082-49d6-b061-0b7c1c457d96'] in dv-cinder-786383-6-iscsi is: [{'id': '51108221-2082-49d6-b061-0b7c1c457d96', 'name': 'tempest-TestMinimumBasicScenario-850645996-router', 'tenant_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:23Z', 'updated_at': '2021-05-25T16:21:01Z', 'revision_number': 6, 'project_id': '5d2ebdea3bd843dfbaea75179867aaa5', 'gw_port_host': None}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:21:01.851912 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3c24b03f-319d-456f-bef2-6471e7ba5dd3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:01.908461 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Calling delete_port for d0938a43-4529-4009-ac8b-6af8adc4bb26 owned by network:router_gateway {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:02.194383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.196149 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-698891a1-54a0-4e6a-8e10-11dc757f22f6 tempest-AttachVolumeTestJSON-2139287539 tempest-AttachVolumeTestJSON-2139287539-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:02.249885 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0938a43-4529-4009-ac8b-6af8adc4bb26,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:02.289676 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.290070 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.290440 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.290808 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.291173 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.291536 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.291923 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.292284 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.292642 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.292996 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.293350 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.293701 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:02.301556 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:02.359523 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.552306 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.554962 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.706145 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.706972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 51108221-2082-49d6-b061-0b7c1c457d96 {{(pid=98391) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:21:02.728876 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.730440 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-9d6e4fb5-13e3-4a02-a389-b020cb3c23c6 admin admin] 10.222.0.25 "DELETE /v2.0/routers/51108221-2082-49d6-b061-0b7c1c457d96 HTTP/1.1" status: 204 len: 168 time: 1.8194983 May 25 16:21:02.733623 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56376) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:02.818187 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Deleting subnet 34f9fa10-b0a2-4008-8b3a-e7097da2d46a {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:21:02.822104 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.889120 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:02.916186 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6902968-d614-4357-94f7-bda7ec1f94b1 req-7ec666da-4ede-49c8-a992-6737b9a42990 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:02.921765 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c6902968-d614-4357-94f7-bda7ec1f94b1 req-7ec666da-4ede-49c8-a992-6737b9a42990 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1067209 May 25 16:21:02.947510 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.017880 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d0938a43-4529-4009-ac8b-6af8adc4bb26 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:03.055069 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.065523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: d0938a43-4529-4009-ac8b-6af8adc4bb26 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:03.065987 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d0938a43-4529-4009-ac8b-6af8adc4bb26 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:03.066478 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device e727c6d0-b122-4b8d-b0ef-9174992e8f76 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:03.076303 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c6902968-d614-4357-94f7-bda7ec1f94b1 req-adcd39c8-ef8a-47c5-8a53-21a2832619d1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1532836 May 25 16:21:03.105974 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: e727c6d0-b122-4b8d-b0ef-9174992e8f76 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:03.105974 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device e727c6d0-b122-4b8d-b0ef-9174992e8f76 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:03.130506 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22030dfa-529a-4793-b184-8f5412362c32 req-44ddc30c-7f91-4876-85a6-c83544aabd7a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:03.133157 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-22030dfa-529a-4793-b184-8f5412362c32 req-44ddc30c-7f91-4876-85a6-c83544aabd7a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 945 time: 0.1947658 May 25 16:21:03.286903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:03.287877 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.359104 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.367121 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5def3f10-8e1c-48da-8b35-731784c6a9b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:03.403773 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34f9fa10-b0a2-4008-8b3a-e7097da2d46a,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:03.405951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.408932 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:03.415860 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-4b6e8a80-a6a4-491c-a861-1503ff456193 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/34f9fa10-b0a2-4008-8b3a-e7097da2d46a HTTP/1.1" status: 204 len: 168 time: 0.6788030 May 25 16:21:03.416047 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25d2e0f1-045e-4633-95a9-4d960c17c376 None None] Network 62d43163-f679-4f52-9314-5c4893113cf3 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:21:03.416161 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56380) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:03.453834 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] For port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:03.454195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.551778 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.634889 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Deleting port 2c833278-744a-4936-a9b2-f2841ee1f096 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:03.635141 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.770589 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] For port 2c833278-744a-4936-a9b2-f2841ee1f096, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=2c833278-744a-4936-a9b2-f2841ee1f096,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:03.771031 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.817827 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] DHCP port deletion for 62d43163-f679-4f52-9314-5c4893113cf3 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:21:03.855294 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.855777 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.856096 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP 3e834328-ccb9-401f-896a-5282f31c7863 disassociated. External IP: 172.27.1.142, port: d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008. May 25 16:21:03.856432 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:03.925822 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Deleting port 2c833278-744a-4936-a9b2-f2841ee1f096 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:03.926703 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.933041 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Calling delete_port for 2c833278-744a-4936-a9b2-f2841ee1f096 owned by network:dhcp {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:03.991436 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:03.996818 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b8bbc383-7dfd-405c-b066-a5d9fdb9cf61 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:04.020242 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.027972 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-1850319d-a411-40a7-81ca-c6f6aa40e2fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:04.043892 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Pushing event deleted for resources: {'Port': ['ID=2c833278-744a-4936-a9b2-f2841ee1f096,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:04.045925 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] No DVR routers for this DVR port 2c833278-744a-4936-a9b2-f2841ee1f096 on host dv-cinder-786383-6-iscsi {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:21:04.047600 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:04.084537 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:04.088551 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:04.109476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] For port 2c833278-744a-4936-a9b2-f2841ee1f096, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=2c833278-744a-4936-a9b2-f2841ee1f096,segment=NetworkSegment(f7170f64-429b-4536-8abe-e62f660fad02),segment_id=f7170f64-429b-4536-8abe-e62f660fad02)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:04.110055 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.172923 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.189383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['62d43163-f679-4f52-9314-5c4893113cf3']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:04.203486 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f7170f64-429b-4536-8abe-e62f660fad02') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:04.203825 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f7170f64-429b-4536-8abe-e62f660fad02') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:04.221917 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.240592 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.248847 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Releasing vlan 840 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:21:04.249288 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:21:04.264011 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:21:04.282508 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Calling delete_port for 2c833278-744a-4936-a9b2-f2841ee1f096 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:04.334297 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5593f555-c4a5-454a-8687-02b08267521f req-a26bb3a6-c966-4e7b-a21c-b2fc91c7dc83 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 210 time: 0.0653582 May 25 16:21:04.335712 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.342774 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:04.364409 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:21:04.366462 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.371448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.374091 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:04.395598 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Pushing event deleted for resources: {'Port': ['ID=2c833278-744a-4936-a9b2-f2841ee1f096,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:04.397501 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Pushing event deleted for resources: {'Network': ['ID=62d43163-f679-4f52-9314-5c4893113cf3,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:04.400158 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:04.404321 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.405038 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.405793 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.406154 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.406492 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.406922 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.407142 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.407674 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.408273 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.408778 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.409280 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.409660 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:21:04.413899 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:04.414763 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7173a56b-7dd9-4f3e-8b26-8d42d2f3d4eb None None] No DVR routers for this DVR port 2c833278-744a-4936-a9b2-f2841ee1f096 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:21:04.420138 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-ff5d9e61-eab9-4a0f-b72c-68f2d4580a0e admin admin] 10.222.0.25 "DELETE /v2.0/networks/62d43163-f679-4f52-9314-5c4893113cf3 HTTP/1.1" status: 204 len: 168 time: 1.0029309 May 25 16:21:04.425201 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56386) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:04.620842 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.720987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:21:04.731432 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:21:04.748156 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:04.748900 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:04.803698 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] No DVR routers for this DVR port d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:21:04.808232 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:04.809276 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'name': 'network-vif-deleted', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:21:04.828517 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-22030dfa-529a-4793-b184-8f5412362c32 req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "DELETE /v2.0/ports/d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 HTTP/1.1" status: 204 len: 173 time: 1.6891685 May 25 16:21:04.864814 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a73c9a49-d1dd-43ba-9596-7a1a244fb260', 'name': 'network-vif-deleted', 'tag': 'd1b4ef3d-c3bc-4803-ba29-9fcb76f5d008', 'status': 'completed', 'code': 200} May 25 16:21:04.962262 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 2c833278-744a-4936-a9b2-f2841ee1f096 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:04.993605 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:05.003414 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 2c833278-744a-4936-a9b2-f2841ee1f096 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:05.003949 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 2c833278-744a-4936-a9b2-f2841ee1f096 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:05.249171 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:05.394554 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:05.399477 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:21:05.409428 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:05.410042 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:05.527943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-93234da9-7380-404f-973f-3b5c4f8d89cb req-fd74bda3-41d9-4e43-8593-4e1224a621ab tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:21:05.546216 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-93234da9-7380-404f-973f-3b5c4f8d89cb req-fd74bda3-41d9-4e43-8593-4e1224a621ab tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:21:05.547525 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-93234da9-7380-404f-973f-3b5c4f8d89cb req-fd74bda3-41d9-4e43-8593-4e1224a621ab tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=a73c9a49-d1dd-43ba-9596-7a1a244fb260 HTTP/1.1" status: 200 len: 210 time: 0.0811765 May 25 16:21:05.604098 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:05.788846 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Deleting port d2b9d0f8-735d-48b3-9d9b-0901cc802549 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:05.789840 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:05.939736 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] For port d2b9d0f8-735d-48b3-9d9b-0901cc802549, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=d2b9d0f8-735d-48b3-9d9b-0901cc802549,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:05.940271 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:06.019021 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:06.023384 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-940e97bc-8cc8-4f2a-92ad-e7f85c079f55 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:21:06.069951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Calling delete_port for d2b9d0f8-735d-48b3-9d9b-0901cc802549 owned by network:router_interface {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:06.256393 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba26147d-80f5-46de-ac19-a19ba5693321 None None] New status for floating IP 3e834328-ccb9-401f-896a-5282f31c7863: DOWN {{(pid=98393) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:21:06.262007 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:06.266164 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-198d3147-9569-4ccf-b8dd-0bba46605410 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:06.312215 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Pushing event deleted for resources: {'Port': ['ID=d2b9d0f8-735d-48b3-9d9b-0901cc802549,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:06.315383 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:06.409352 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:06.753588 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:06.893037 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-23e43572-97c1-4d68-8ef7-70ff21692c68 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-714553222&fields=id&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 267 time: 0.0530090 May 25 16:21:06.932904 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:06.991357 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:06.991916 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device d1b4ef3d-c3bc-4803-ba29-9fcb76f5d008 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:07.075525 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-594ffdcd-2b7e-4338-8754-a243ce01c46f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:07.077779 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-594ffdcd-2b7e-4338-8754-a243ce01c46f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.1764054 May 25 16:21:07.105747 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-31453f38-20c2-4db8-b8d8-8911b2c21ab2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/quotas/a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 375 time: 0.0128825 May 25 16:21:07.159738 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98391) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:21:07.204593 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-2769cc65-8f46-4148-b82e-151dc0524077 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0931637 May 25 16:21:07.360922 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98391) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:21:07.371756 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-600101ce-0fe8-482d-8d39-acbda537065b admin admin] 10.222.0.25 "PUT /v2.0/routers/5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9456210 May 25 16:21:07.373134 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Sync routers for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:21:07.374976 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56402) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:07.388658 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-268985e3-7cee-4040-a7af-24735a732efd service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1702311 May 25 16:21:07.390217 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:07.390997 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:07.586321 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks [] for router, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:07.612660 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-62cb223d-633e-425b-83de-dd1f1ed12163 service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2151356 May 25 16:21:07.637708 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:07.797006 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:07.889720 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Deleting port b4a335c3-877c-40a3-8964-3baff063ae66 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:07.890046 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:07.963874 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124'}], 'enable_snat': True}, 'gw_port_id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:21:06Z', 'revision_number': 5, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port': {'id': 'b4a335c3-877c-40a3-8964-3baff063ae66', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a7:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'device_owner': 'network:router_gateway', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.124', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:34Z', 'updated_at': '2021-05-25T16:18:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:07.968974 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Checking router: 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:21:07.983400 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Routers {'5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:07.984049 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:08.033956 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] For port b4a335c3-877c-40a3-8964-3baff063ae66, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b4a335c3-877c-40a3-8964-3baff063ae66,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:08.034343 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.171992 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] Set router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:08.286393 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Calling delete_port for b4a335c3-877c-40a3-8964-3baff063ae66 owned by network:router_gateway {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:08.349818 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:21:07Z', 'revision_number': 6, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:08.355478 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1443e843-c2ab-44a9-afe2-13c06ac85080 None None] The sync data for ids ['5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900'] in dv-cinder-786383-6-iscsi is: [{'id': '5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900', 'name': 'tempest-TestMinimumBasicScenario-506796955-router', 'tenant_id': '603cb1c40ecf43fb85588002c1d85e19', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:33Z', 'updated_at': '2021-05-25T16:21:07Z', 'revision_number': 6, 'project_id': '603cb1c40ecf43fb85588002c1d85e19', 'gw_port_host': None}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:21:08.489135 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.497628 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e2-b6fa-492a-9972-d73386711fda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:08.583569 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Pushing event deleted for resources: {'Port': ['ID=b4a335c3-877c-40a3-8964-3baff063ae66,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:08.589588 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:08.742942 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.935380 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.938331 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.964476 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.964972 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 {{(pid=98391) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:21:08.979799 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Notify callbacks [] for router, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:08.980939 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] 10.222.0.25 "DELETE /v2.0/routers/5e2811e9-c4fc-48d0-9c1c-e9ded7fc8900 HTTP/1.1" status: 204 len: 168 time: 1.6049550 May 25 16:21:08.983705 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56412) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:09.060065 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Deleting subnet e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3 {{(pid=98391) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:21:09.063688 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:09.153926 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-884900'] for subnet, precommit_delete_associations {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:09.169611 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-8dd5b407-6621-4d36-9479-38d223ca7f59 req-003ea8e5-a3cd-40c5-9538-fdf0f005c2ed tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 210 time: 0.0856912 May 25 16:21:09.260569 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b4a335c3-877c-40a3-8964-3baff063ae66 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:09.293448 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:09.313641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: b4a335c3-877c-40a3-8964-3baff063ae66 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:09.314517 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b4a335c3-877c-40a3-8964-3baff063ae66 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:09.315338 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d2b9d0f8-735d-48b3-9d9b-0901cc802549 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:09.355543 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: d2b9d0f8-735d-48b3-9d9b-0901cc802549 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:09.359364 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device d2b9d0f8-735d-48b3-9d9b-0901cc802549 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:09.668376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3708799', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2192353'] for subnet, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:09.674531 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:09.713745 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:09.715867 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:09.718928 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:09.723827 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d66f3b91-9cbf-4adf-8d45-c67562f179f0 None None] Network 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:21:09.724267 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-8f7478e7-d050-4344-b693-12f36c41a673 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/e5d4fe12-fd48-4612-9e5a-62d7cf0b04c3 HTTP/1.1" status: 204 len: 168 time: 0.7390842 May 25 16:21:09.727934 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56428) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:09.868271 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.006393 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Deleting port b7b7e1cb-cfe3-41b8-985b-73819567a003 {{(pid=98391) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:10.006752 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.078984 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] DHCP port deletion for 5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:21:10.138268 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.db [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] For port b7b7e1cb-cfe3-41b8-985b-73819567a003, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b7b7e1cb-cfe3-41b8-985b-73819567a003,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98391) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:10.138587 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.156246 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Deleting port b7b7e1cb-cfe3-41b8-985b-73819567a003 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:21:10.156706 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.287262 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.plugin [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Calling delete_port for b7b7e1cb-cfe3-41b8-985b-73819567a003 owned by network:dhcp {{(pid=98391) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:10.301349 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] For port b7b7e1cb-cfe3-41b8-985b-73819567a003, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=b7b7e1cb-cfe3-41b8-985b-73819567a003,segment=NetworkSegment(88cde3e6-4797-40ec-b8a3-f95a39764df7),segment_id=88cde3e6-4797-40ec-b8a3-f95a39764df7)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:10.302367 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.381940 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3707020'] for port, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.394274 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-5ad3245a-051d-4dc0-afc7-ead6b0530104 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:10.406296 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-f2e4a23b-e9a8-4f9d-bd23-132ec427015b req-35022a9d-2775-4d92-9e0a-f175c31731a6 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 210 time: 0.0794389 May 25 16:21:10.526063 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Calling delete_port for b7b7e1cb-cfe3-41b8-985b-73819567a003 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:21:10.564242 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Pushing event deleted for resources: {'Port': ['ID=b7b7e1cb-cfe3-41b8-985b-73819567a003,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:10.566345 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] No DVR routers for this DVR port b7b7e1cb-cfe3-41b8-985b-73819567a003 on host dv-cinder-786383-6-iscsi {{(pid=98391) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:21:10.568206 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:10.586919 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.599187 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:10.654608 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Pushing event deleted for resources: {'Port': ['ID=b7b7e1cb-cfe3-41b8-985b-73819567a003,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:10.657339 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] No DVR routers for this DVR port b7b7e1cb-cfe3-41b8-985b-73819567a003 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:21:10.659215 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:10.710348 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.733492 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b']}} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:10.749728 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88cde3e6-4797-40ec-b8a3-f95a39764df7') {'for_net_delete': True} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:10.750195 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.services.segments.db [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88cde3e6-4797-40ec-b8a3-f95a39764df7') {} {{(pid=98391) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:10.766391 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-80b62aac-99a1-4f9a-a98f-09a990f0885c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:10.768435 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-80b62aac-99a1-4f9a-a98f-09a990f0885c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.2566574 May 25 16:21:10.770351 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-884911'] for segment, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.799853 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.813472 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Releasing vlan 842 on physical network physnet1 to pool {{(pid=98391) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:21:10.814118 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3707097'] for segment, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:10.833046 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-147ae681-0f57-4963-ab7b-37fc7ae60279 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 379 time: 0.0486999 May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: Traceback (most recent call last): May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: timer() May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: cb(*args, **kw) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: return func(*args, **kwargs) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: self._notify() May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: self.callback(batched_events) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: event.method(event) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: return f(self, *a, **k) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._get(url).json() May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: return self.request(url, 'GET', **kwargs) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:21:10.839737 dv-cinder-786383-6-iscsi neutron-server[98391]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:21:10.845133 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'port': {'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'admin_state_up': True, 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'security_groups': ['a5265a9e-7809-4275-93e5-3ff80a9af0d2']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:21:10.964418 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b7b7e1cb-cfe3-41b8-985b-73819567a003 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:21:10.981639 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.003810 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.007467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:21:11.018378 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:11.019175 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:21:11.030934 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: b7b7e1cb-cfe3-41b8-985b-73819567a003 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:21:11.031681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device b7b7e1cb-cfe3-41b8-985b-73819567a003 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:21:11.039021 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Made reservation on behalf of a899ba7d8bc0472caa53a2e65d1bd7ea for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:21:11.045804 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.058527 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] 10.222.0.25 "DELETE /v2.0/networks/5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b HTTP/1.1" status: 204 len: 168 time: 1.3270352 May 25 16:21:11.067466 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Pushing event deleted for resources: {'Network': ['ID=5c9b0a21-de1f-4fea-be56-2a6af2d9bd1b,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:11.075234 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-b2ec36d6-4166-483a-8b8e-5447a304f335 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:11.288965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.20.0.9 (0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a/659f33e2-068d-40bb-84cc-c31f8933e023/73688523-f562-4269-bd2c-3389c0751537) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:21:11.334427 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56436) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:11.402772 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-3a06efdb-8116-420f-ab71-21b22610579e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5d2ebdea3bd843dfbaea75179867aaa5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0663855 May 25 16:21:11.405887 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56440) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:11.473526 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.510323 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.541062 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.570626 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.574675 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-99a3ee98-c19a-45e0-876e-b8ee558e5ad4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:11.590481 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:11.593721 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:11.610506 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.612281 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-2703fefb-db2e-43ec-9433-87b27f36bac3 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e8868291-8ea5-4bf4-987b-2ef3cdbd8c9d HTTP/1.1" status: 204 len: 168 time: 0.2051802 May 25 16:21:11.799485 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Transition to ACTIVE for port object 73688523-f562-4269-bd2c-3389c0751537 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:21:11.804836 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-977f7928-3867-4347-8786-179701559d08 req-3b292cae-abf8-4055-888d-bb16a14cfca1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 210 time: 0.2578936 May 25 16:21:11.851186 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:11.862606 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-09ea7653-4d14-4d91-83ea-25c36ddc31b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:11.980339 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:21:11.986225 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:21:11.994156 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:21:12.053762 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56450) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:12.097023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:12.106917 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:12.114804 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-40e1cff0-b72e-4983-adae-5c9949cf2443 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=603cb1c40ecf43fb85588002c1d85e19&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0595722 May 25 16:21:12.117872 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56454) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:12.146901 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:12.148032 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.191977 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-fe2dd04c-06ac-4751-9291-bf98a580794a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3537040 May 25 16:21:12.192619 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.210531 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Request body: {'port': {'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:21:12.237667 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.237870 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-bb31eda2-eb06-45ea-8c16-5eb0ec3dec80 None None] Provisioning for port 73688523-f562-4269-bd2c-3389c0751537 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:21:12.249343 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-bb31eda2-eb06-45ea-8c16-5eb0ec3dec80 None None] Provisioning complete for port 73688523-f562-4269-bd2c-3389c0751537 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:21:12.249969 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bb31eda2-eb06-45ea-8c16-5eb0ec3dec80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.306574 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.316791 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-27ed56a4-2657-4909-846a-d0d8dc2fd214 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:12.332814 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=850630c5-edaf-4181-8d45-78b1aa6424f2,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:12.338095 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:12.344928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.346848 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.348856 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1546b36c-4cc3-47a9-b3f2-8226edb937b6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/850630c5-edaf-4181-8d45-78b1aa6424f2 HTTP/1.1" status: 204 len: 168 time: 0.2296860 May 25 16:21:12.412807 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-bb31eda2-eb06-45ea-8c16-5eb0ec3dec80 None None] Port 73688523-f562-4269-bd2c-3389c0751537 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:21:12.755148 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 73688523-f562-4269-bd2c-3389c0751537 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:21:12.764245 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.783497 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Transition to ACTIVE for port object 73688523-f562-4269-bd2c-3389c0751537 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:21:12.788071 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:12.792997 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0388684c-a9e9-4c3e-8f32-fa1c6d1437da tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:13.017078 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Pushing event updated for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:13.020324 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:13.121044 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Attempting to bind port 73688523-f562-4269-bd2c-3389c0751537 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:21:13.121381 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Attempting to bind port 73688523-f562-4269-bd2c-3389c0751537 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:21:13.121718 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Attempting to bind port 73688523-f562-4269-bd2c-3389c0751537 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:21:13.136074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a522cb0-3e2f-46f5-98e7-d3ce905def5a req-631c5877-b8ef-418f-8539-0e2cf6596636 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:13.136833 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-7a522cb0-3e2f-46f5-98e7-d3ce905def5a req-631c5877-b8ef-418f-8539-0e2cf6596636 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:21:13.139775 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Port 73688523-f562-4269-bd2c-3389c0751537 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:21:13.140118 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Attempting to bind port 73688523-f562-4269-bd2c-3389c0751537 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:21:13.148973 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 21, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:21:13.149319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:21:13.149711 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Bound using segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:21:13.150164 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Bound port: 73688523-f562-4269-bd2c-3389c0751537, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:21:13.150516 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:13.199537 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-7a522cb0-3e2f-46f5-98e7-d3ce905def5a req-631c5877-b8ef-418f-8539-0e2cf6596636 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:21:13.200743 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7a522cb0-3e2f-46f5-98e7-d3ce905def5a req-631c5877-b8ef-418f-8539-0e2cf6596636 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.2719944 May 25 16:21:13.289905 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7a522cb0-3e2f-46f5-98e7-d3ce905def5a req-71396e3b-b88b-439c-8ab3-f1f56e63e7ce tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0827782 May 25 16:21:13.296925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:21:13.301130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73688523-f562-4269-bd2c-3389c0751537,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:21:13.306052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:13.310309 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:13.368525 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:13.369091 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:13.370708 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] 10.222.0.74 "PUT /v2.0/ports/73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 1093 time: 1.1647313 May 25 16:21:13.374028 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:21:13.443361 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537', 'status': 'completed', 'code': 200} May 25 16:21:13.447183 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Pushing event updated for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:13.450599 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-337991da-0005-44d3-ba08-c56a678ed812 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:13.544023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-cbaa7b90-dcd3-4083-aaa8-971d8f303950 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:13.545559 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-cbaa7b90-dcd3-4083-aaa8-971d8f303950 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1096 time: 0.0842195 May 25 16:21:13.629148 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-384e8b83-6525-467d-b6a8-222de996c44a service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 217 time: 0.0672739 May 25 16:21:13.704791 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-c761fa4e-efaa-4af1-b295-bd6f28dd5e7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:13.706265 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-c761fa4e-efaa-4af1-b295-bd6f28dd5e7d service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0702012 May 25 16:21:13.788963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-48c09599-b5eb-4a5f-928e-c0427f974529 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:13.790446 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-48c09599-b5eb-4a5f-928e-c0427f974529 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0769408 May 25 16:21:13.935738 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-4b6ab5d4-a07a-460d-b49f-c8887492ef44 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1367238 May 25 16:21:14.181612 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-004b9018-b84d-47d3-b683-4c1c9a1816fc req-cc71a60b-e8bd-4651-ad90-6f0bff78aee2 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2393007 May 25 16:21:14.374181 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-c78fa406-be9f-498e-834e-391ef54a0127 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:14.376002 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-c78fa406-be9f-498e-834e-391ef54a0127 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1096 time: 0.1035414 May 25 16:21:14.596008 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-d0f59796-c5c7-4003-9a07-5855f94c3992 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:14.597393 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-d0f59796-c5c7-4003-9a07-5855f94c3992 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2145784 May 25 16:21:14.674662 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-e9459537-be67-487b-9523-f5807f3aaefb service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 217 time: 0.0702753 May 25 16:21:14.682838 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f46c54-b1b4-413a-9408-4f8db1b32d74 req-161e54c6-4a0c-41a5-857d-d0b260678edc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:14.684418 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7f46c54-b1b4-413a-9408-4f8db1b32d74 req-161e54c6-4a0c-41a5-857d-d0b260678edc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.2117791 May 25 16:21:14.786404 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-0207fb7b-72a1-463f-bb29-3a668efec757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:14.788466 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-0207fb7b-72a1-463f-bb29-3a668efec757 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1031535 May 25 16:21:14.791332 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a7f46c54-b1b4-413a-9408-4f8db1b32d74 req-0389b2e9-f3d7-4aa7-832e-fe059baefd0b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0723124 May 25 16:21:14.901694 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-695a72c7-68be-4a39-bb5f-a4c835b9a5e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:14.903204 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-695a72c7-68be-4a39-bb5f-a4c835b9a5e2 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1059566 May 25 16:21:15.053916 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-16e8618c-9c09-4431-96bc-357dc9a9463d service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1435230 May 25 16:21:15.196177 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-b764eb27-3c09-41e3-8349-d9d729b7ab8c req-ebc1b340-9f4c-4919-ac33-00f28cde1611 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1345310 May 25 16:21:15.992247 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00554eaf-edf1-4972-b379-d99ccaa7ca25 req-d9f97f71-ea1c-46c6-a50f-e35388001a1b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:15.993709 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00554eaf-edf1-4972-b379-d99ccaa7ca25 req-d9f97f71-ea1c-46c6-a50f-e35388001a1b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.0879498 May 25 16:21:16.048974 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-00554eaf-edf1-4972-b379-d99ccaa7ca25 req-16d3ee3d-4b53-45f7-b389-47ae32e58d8c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483246 May 25 16:21:17.244845 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945a5d68-277f-49ff-a051-a716e3c9a1bd req-8c971448-e724-4d74-85b3-60d48f08e130 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:17.246361 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-945a5d68-277f-49ff-a051-a716e3c9a1bd req-8c971448-e724-4d74-85b3-60d48f08e130 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.0855410 May 25 16:21:17.298319 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-945a5d68-277f-49ff-a051-a716e3c9a1bd req-ff76d9c4-6e16-4454-9b95-2ab2643a7c6a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458047 May 25 16:21:18.497668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434736f1-5873-4349-9acc-b31a63137258 req-59d1d096-99a7-46ca-be8f-2bf79895489b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:18.499540 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-434736f1-5873-4349-9acc-b31a63137258 req-59d1d096-99a7-46ca-be8f-2bf79895489b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.0928535 May 25 16:21:18.549174 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-434736f1-5873-4349-9acc-b31a63137258 req-b71fa646-fb13-42a5-9964-27145553ce0e tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428989 May 25 16:21:19.776645 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a1fd4f-34e9-4ea8-a4f1-2c77291168d0 req-54d6e1d7-9f6c-4697-b2b7-41ec1b126703 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:19.778269 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-82a1fd4f-34e9-4ea8-a4f1-2c77291168d0 req-54d6e1d7-9f6c-4697-b2b7-41ec1b126703 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.0913572 May 25 16:21:19.828895 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-82a1fd4f-34e9-4ea8-a4f1-2c77291168d0 req-a23eda54-bf3e-4018-9c88-c4c4a6f92ba9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439298 May 25 16:21:20.975664 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73688523-f562-4269-bd2c-3389c0751537 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:21:21.037393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7743943a-b2f2-4d42-8fcf-dfbd5cf92c31 req-5f7df0b4-2947-4d4b-bfaa-7a78f4350227 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:21.039036 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7743943a-b2f2-4d42-8fcf-dfbd5cf92c31 req-5f7df0b4-2947-4d4b-bfaa-7a78f4350227 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 943 time: 0.0922992 May 25 16:21:21.106958 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-7743943a-b2f2-4d42-8fcf-dfbd5cf92c31 req-35bef4c7-3274-4cce-81b9-f1d80c8b821d tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0614591 May 25 16:21:21.201790 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73688523-f562-4269-bd2c-3389c0751537,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:21.216432 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': '73688523-f562-4269-bd2c-3389c0751537', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 828, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:21:21.278314 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:21.297365 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 73688523-f562-4269-bd2c-3389c0751537 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:21:21.315901 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73688523-f562-4269-bd2c-3389c0751537,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:21.322805 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:21.325006 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-dc96fd12-3901-41b1-942d-32c5e1eff63d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:21.405780 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:21.409503 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:21.621763 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['73688523-f562-4269-bd2c-3389c0751537'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:21:22.370979 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba0d328-4654-4e84-9aa8-23b0dd728df3 req-a929fc3d-ee6a-4066-a209-2f73d9d41345 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:22.372606 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eba0d328-4654-4e84-9aa8-23b0dd728df3 req-a929fc3d-ee6a-4066-a209-2f73d9d41345 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 944 time: 0.0846860 May 25 16:21:22.429520 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-eba0d328-4654-4e84-9aa8-23b0dd728df3 req-4ee9af73-03bd-4b54-8dd0-d2fda29b9056 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459323 May 25 16:21:22.993481 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73688523-f562-4269-bd2c-3389c0751537 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:21:23.094629 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port 73688523-f562-4269-bd2c-3389c0751537 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:21:23.107118 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port 73688523-f562-4269-bd2c-3389c0751537 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:21:23.107495 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:23.239467 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:23.275744 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73688523-f562-4269-bd2c-3389c0751537'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:21:23.291084 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73688523-f562-4269-bd2c-3389c0751537,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:21:23.297562 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:23.302095 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:23.360992 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73688523-f562-4269-bd2c-3389c0751537', 'code': 200} May 25 16:21:23.428278 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:23.431899 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:23.815108 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f77c41-5a8c-4f94-a129-908ff7f923fb req-73ffc53b-77e6-4c32-bb24-7eee2331f4b4 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:23.816769 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6f77c41-5a8c-4f94-a129-908ff7f923fb req-73ffc53b-77e6-4c32-bb24-7eee2331f4b4 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.1680696 May 25 16:21:23.819366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71237c61-e25d-411d-9fcf-9e44a6edf972 req-ea7f93ad-8085-427e-bea6-f9177fbefb37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:23.820916 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-71237c61-e25d-411d-9fcf-9e44a6edf972 req-ea7f93ad-8085-427e-bea6-f9177fbefb37 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.1383250 May 25 16:21:24.013510 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e6f77c41-5a8c-4f94-a129-908ff7f923fb req-707c3728-5cd8-463e-968e-137056875884 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1901660 May 25 16:21:24.015276 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-71237c61-e25d-411d-9fcf-9e44a6edf972 req-936a647b-6930-47db-ab20-32ca6428ca3a service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1742826 May 25 16:21:25.266055 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f04a5e1-3a7b-452b-a266-35cae41e9481 req-0a4436ff-5494-4871-ae9a-e18b2f6427ad tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:25.270159 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f04a5e1-3a7b-452b-a266-35cae41e9481 req-0a4436ff-5494-4871-ae9a-e18b2f6427ad tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.1393166 May 25 16:21:25.323057 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9f04a5e1-3a7b-452b-a266-35cae41e9481 req-25464bd3-075d-45bd-93ae-7ca85da7cb3c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466361 May 25 16:21:26.537799 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733bad6f-2434-4f6f-ba33-328c2c018e3c req-c852e7d4-9e0b-4b52-8536-ebf62aa716e3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:26.539397 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-733bad6f-2434-4f6f-ba33-328c2c018e3c req-c852e7d4-9e0b-4b52-8536-ebf62aa716e3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.1025887 May 25 16:21:26.590475 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-733bad6f-2434-4f6f-ba33-328c2c018e3c req-e8f7da7b-0eec-4dad-ad78-de3e2e4e0843 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448132 May 25 16:21:26.809494 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb47714-a01f-4198-8dcc-0738dffcbda4 req-97456c44-a881-4ddb-ad99-eda18819f656 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:26.811114 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1bb47714-a01f-4198-8dcc-0738dffcbda4 req-97456c44-a881-4ddb-ad99-eda18819f656 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.1029739 May 25 16:21:26.863143 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1bb47714-a01f-4198-8dcc-0738dffcbda4 req-b8113107-0874-42f0-a67e-a0a339c21136 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440872 May 25 16:21:26.892374 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56500) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:26.972869 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32cffffe-c0df-4688-b331-282a88611272 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:26.974468 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-32cffffe-c0df-4688-b331-282a88611272 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1093 time: 0.0809286 May 25 16:21:26.978270 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56504) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:21:26.984006 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address': '172.20.0.9'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:21:26.992439 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:21:26.996832 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:floatingip and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:21:27.000788 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:21:27.008446 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:21:27.022374 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:27.180477 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:27.347974 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.27.1.154 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/07114f7c-0fdb-4700-837f-4e5d52f76414) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:21:27.522180 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:27.555524 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:27.559841 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-f95a2567-5b5c-4b43-8236-248ad5f11226 tempest-AttachVolumeShelveTestJSON-1349360131 tempest-AttachVolumeShelveTestJSON-1349360131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:27.628926 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:21:27.632483 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:21:27.638806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:21:27.703722 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=07114f7c-0fdb-4700-837f-4e5d52f76414,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:27.716583 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:28.285791 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:28.412955 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:28.674117 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:28.681398 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:28.689903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:21:28.920406 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=07114f7c-0fdb-4700-837f-4e5d52f76414,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:21:28.925548 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:21:28.930938 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:29.118246 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP 22e50bf4-0fe7-46a1-bab8-761c52ebf705 associated. External IP: 172.27.1.154, port: 73688523-f562-4269-bd2c-3389c0751537. May 25 16:21:29.275792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-392c9258-e1dd-4b7d-834f-6e03a9711463 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:29.526159 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:21:29.723806 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:21:29.735143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:21:29.746733 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:29.747381 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:29.754126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:29.816699 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8371725 May 25 16:21:29.817272 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:21:29.873444 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537', 'status': 'completed', 'code': 200} May 25 16:21:30.000951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4623775-3716-4e40-b54b-a98ac613e809 req-4388fab9-4fb9-48f3-96e9-7881451c67ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:30.002797 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-4388fab9-4fb9-48f3-96e9-7881451c67ee service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.0811682 May 25 16:21:30.036780 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:30.161584 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4623775-3716-4e40-b54b-a98ac613e809 req-8413e59e-15e7-496c-b2b4-006796ee8ad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:30.163686 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-8413e59e-15e7-496c-b2b4-006796ee8ad7 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1536989 May 25 16:21:30.307462 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-8102fc7d-817a-4b45-90de-c4a43980551b service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 999 time: 0.1356308 May 25 16:21:30.382058 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4623775-3716-4e40-b54b-a98ac613e809 req-ac6f8c61-e957-4396-9b9f-2c8ea3519499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:30.383762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-ac6f8c61-e957-4396-9b9f-2c8ea3519499 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0692890 May 25 16:21:30.471451 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:28Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:30.472256 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4623775-3716-4e40-b54b-a98ac613e809 req-6d1be7c2-4d69-4726-a558-853e9647c6f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:21:30.473690 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-6d1be7c2-4d69-4726-a558-853e9647c6f8 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0818863 May 25 16:21:30.476996 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:21:30.487417 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:21:30.488026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:21:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:30.821489 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-f82ab34b-385c-4368-b58e-0c7b4ea6af09 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3302600 May 25 16:21:30.825536 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:21:30.969610 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d4623775-3716-4e40-b54b-a98ac613e809 req-251e387a-12ae-4f5f-8b28-562d76e43ae9 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1407878 May 25 16:21:31.266845 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:28Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:21:31.272112 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07b79b2b-1ab0-44db-9e8f-568689a516c8 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:28Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:21:31.622919 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:31.658786 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20a04004-8197-4949-be78-ec95bf92cf73 None None] New status for floating IP 22e50bf4-0fe7-46a1-bab8-761c52ebf705: ACTIVE {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:21:31.799683 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2b375525-62fd-47f3-8177-40ebbdcef8bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:32.911026 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:33.432608 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:21:34.629727 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:36.347450 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:21:59.258559 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bcf0a9bc-d310-4709-a581-654cefb296b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:01.620159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:01.793173 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5694fd40-c2a6-4a40-8434-f74ecc34116e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:02.915264 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:04.639112 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:06.361907 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:10.432544 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:22:17.793183 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-d6f830d9-0bd0-458f-8fcd-8499cda43f56 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0824888 May 25 16:22:17.986938 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-e9e7b94e-2c24-44bb-9701-1406f0dfa955 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:22:17.988392 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-e9e7b94e-2c24-44bb-9701-1406f0dfa955 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.0961633 May 25 16:22:18.168752 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-4d74c426-5245-4198-9136-de0e4353a7c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:22:18.171318 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-4d74c426-5245-4198-9136-de0e4353a7c5 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1590550 May 25 16:22:18.334873 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-d307e216-1034-4f8a-83c8-b44911545491 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 1001 time: 0.1556861 May 25 16:22:18.418455 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-d1e461f3-8238-4942-8395-429dd5d7830d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:22:18.419962 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-d1e461f3-8238-4942-8395-429dd5d7830d service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0761185 May 25 16:22:18.508406 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-b3d9dbaa-205d-4f56-afdb-087d1afc8a15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:22:18.510419 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-b3d9dbaa-205d-4f56-afdb-087d1afc8a15 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0807757 May 25 16:22:18.670212 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-fa2e97d3-b31c-4669-85fc-8684539ff1ff service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1525779 May 25 16:22:18.821486 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-3acbfbd4-3fea-48f6-bd97-f89af0eb0bd6 req-06feecea-acd8-4656-93bc-9d828cb0ee07 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1436822 May 25 16:22:29.264939 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-27777991-3f34-4609-9094-3653b306e035 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:31.617396 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:31.807781 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-c42056b3-37eb-4305-ac6e-4471a3d6a209 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:32.930414 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:34.640892 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:36.385119 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:22:47.438031 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:22:59.258115 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-895c27e2-fa46-4381-a2df-75807f13fa62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:01.615833 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:01.805648 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9d91b383-2741-4d82-9ce4-37b4b122a78f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:02.923984 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:04.638343 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:06.395216 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:06.968853 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-181f3906-bcb1-47ef-82c1-89fe32682fd2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-714553222&fields=id&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 267 time: 0.0435162 May 25 16:23:07.163075 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-844de92d-24b7-4157-89ba-47601fc31bc9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:07.164595 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-844de92d-24b7-4157-89ba-47601fc31bc9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.1880767 May 25 16:23:07.180434 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-20912e70-4da2-4ee3-bf6b-9eba227573a1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/quotas/a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 375 time: 0.0098433 May 25 16:23:07.301795 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-d2501261-58ba-4b13-a34a-acb2f5cf1af8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1152139 May 25 16:23:07.473769 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-5689028f-e83a-40f4-a0a0-1c984991a8ee service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1588914 May 25 16:23:07.733745 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-8b8c9c77-1d7f-42fe-8d0b-66296f3162e1 service neutron] 10.222.0.25 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2530098 May 25 16:23:08.213745 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-6b717550-6c9f-4ebe-847c-0d3e05fe7d9a req-8d371562-c574-44c4-9c6e-e7a1f7814330 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 210 time: 0.0743585 May 25 16:23:09.475578 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-caf72980-e36e-43a4-99e3-fa36810c32fb req-5cd214a9-8508-495b-bb4d-8042950f89e0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 210 time: 0.1154368 May 25 16:23:09.547200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-b41d7104-09e1-4e1c-abfe-e2326ffa9e5a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:09.548773 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-b41d7104-09e1-4e1c-abfe-e2326ffa9e5a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 811 time: 0.2098236 May 25 16:23:09.620862 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-18d39ec1-4946-4f28-86d2-298a88077113 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea HTTP/1.1" status: 200 len: 379 time: 0.0541246 May 25 16:23:09.640908 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'port': {'device_id': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'admin_state_up': True, 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'security_groups': ['a5265a9e-7809-4275-93e5-3ff80a9af0d2']}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:23:09.801074 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:23:09.811602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:23:09.823318 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Made reservation on behalf of a899ba7d8bc0472caa53a2e65d1bd7ea for: {'port': 1} {{(pid=98392) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:23:09.828900 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.034490 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.20.0.3 (0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a/659f33e2-068d-40bb-84cc-c31f8933e023/caa23432-9fd8-412a-9f4a-97bbeceea7c6) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:23:10.266695 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.291135 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Transition to ACTIVE for port object caa23432-9fd8-412a-9f4a-97bbeceea7c6 will not be triggered until provisioned by entity DHCP. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:23:10.323920 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.333104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d55c145c-947c-43ab-b899-665e705a8f1c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:10.397723 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:23:10.401280 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:23:10.403964 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:23:10.467895 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:10.486071 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.486815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.486815 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.487178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.487728 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.488031 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.488309 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.488648 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.489010 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.489394 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.489754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.490147 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:10.501336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:10.524749 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:10.525769 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.559061 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9223309 May 25 16:23:10.587491 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Request body: {'port': {'device_id': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:23:10.758608 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-153d726a-5aa1-4a5a-8c46-9cd14c3c968a None None] Provisioning for port caa23432-9fd8-412a-9f4a-97bbeceea7c6 completed by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:23:10.766140 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-153d726a-5aa1-4a5a-8c46-9cd14c3c968a None None] Provisioning complete for port caa23432-9fd8-412a-9f4a-97bbeceea7c6 triggered by entity DHCP. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:23:10.766661 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-153d726a-5aa1-4a5a-8c46-9cd14c3c968a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.790556 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:10.826788 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-153d726a-5aa1-4a5a-8c46-9cd14c3c968a None None] Port caa23432-9fd8-412a-9f4a-97bbeceea7c6 cannot update to ACTIVE because it is not bound. {{(pid=98393) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:23:10.848511 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce49a47-47e3-4eb7-bb6c-46f126ae57eb req-6b31c448-4824-457e-b21d-2c4857adfbb2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:10.849862 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-4ce49a47-47e3-4eb7-bb6c-46f126ae57eb req-6b31c448-4824-457e-b21d-2c4857adfbb2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:23:10.891672 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-4ce49a47-47e3-4eb7-bb6c-46f126ae57eb req-6b31c448-4824-457e-b21d-2c4857adfbb2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:23:10.892863 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4ce49a47-47e3-4eb7-bb6c-46f126ae57eb req-6b31c448-4824-457e-b21d-2c4857adfbb2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 931 time: 0.2714922 May 25 16:23:11.017754 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-4ce49a47-47e3-4eb7-bb6c-46f126ae57eb req-3f863133-bc77-4520-90f7-12452723983f tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1166897 May 25 16:23:11.238495 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id caa23432-9fd8-412a-9f4a-97bbeceea7c6 {{(pid=98392) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:23:11.246578 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:11.261734 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.provisioning_blocks [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Transition to ACTIVE for port object caa23432-9fd8-412a-9f4a-97bbeceea7c6 will not be triggered until provisioned by entity L2. {{(pid=98392) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:23:11.265863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:11.269904 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4ac8020a-c1fd-4d7e-bd4c-2330e1e7b792 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:11.543207 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Pushing event updated for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:11.546319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:11.623411 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Attempting to bind port caa23432-9fd8-412a-9f4a-97bbeceea7c6 on host hv-cinder-78638 for vnic_type normal with profile {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:23:11.623729 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Attempting to bind port caa23432-9fd8-412a-9f4a-97bbeceea7c6 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:23:11.624063 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Attempting to bind port caa23432-9fd8-412a-9f4a-97bbeceea7c6 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:23:11.629908 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Port caa23432-9fd8-412a-9f4a-97bbeceea7c6 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:23:11.630692 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Attempting to bind port caa23432-9fd8-412a-9f4a-97bbeceea7c6 on network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:23:11.638449 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Checking agent: {'id': '9c73aeeb-b013-4308-be01-da3e103de723', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'started_at': datetime.datetime(2021, 5, 25, 15, 39, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 23, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:23:11.638784 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Checking segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98392) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:23:11.639170 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Bound using segment: {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'} {{(pid=98392) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:23:11.639654 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.managers [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Bound port: caa23432-9fd8-412a-9f4a-97bbeceea7c6, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ea9a7f5-8525-4a9d-94f3-311c5943a532', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 828, 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a'}}] {{(pid=98392) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:23:11.640002 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:11.753173 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, cleared binding levels {{(pid=98392) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:23:11.756430 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:23:11.761177 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:11.765105 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-2ff0012f-09f2-4f26-a4d9-8c4692a13179 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:11.822052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:11.822699 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:11.824100 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] 10.222.0.74 "PUT /v2.0/ports/caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 200 len: 1093 time: 1.2497568 May 25 16:23:11.827300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:23:11.866558 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Pushing event updated for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=3']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:11.869959 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:11.928244 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'status': 'completed', 'code': 200} May 25 16:23:11.992902 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-1fad5b9a-cee6-418d-8f60-c237ca51fcf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:11.994403 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-1fad5b9a-cee6-418d-8f60-c237ca51fcf7 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1096 time: 0.1071835 May 25 16:23:12.073695 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-ab331ec7-5185-4030-bc65-4de97aef4a5a service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 200 len: 217 time: 0.0644114 May 25 16:23:12.193114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-63437fff-0234-45f0-9bc5-bae8635d4af2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:12.194632 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-63437fff-0234-45f0-9bc5-bae8635d4af2 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.1142478 May 25 16:23:12.283259 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a04131-24be-4c12-bd12-dd5b8c31fcae req-b6e9ed83-0814-4ce2-a83c-435ce1634050 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:12.284782 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44a04131-24be-4c12-bd12-dd5b8c31fcae req-b6e9ed83-0814-4ce2-a83c-435ce1634050 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.1494281 May 25 16:23:12.317123 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-cc283fbf-e9db-4203-b8ff-9c9387205818 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:12.319162 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-cc283fbf-e9db-4203-b8ff-9c9387205818 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1170065 May 25 16:23:12.410565 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44a04131-24be-4c12-bd12-dd5b8c31fcae req-3d350255-6b6a-44be-9bfa-0b8ac6e47949 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1168871 May 25 16:23:12.476430 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-f54fa0fa-7884-471a-81da-aaf184a3885f service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1480751 May 25 16:23:12.617049 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-614152aa-044f-4c10-94ba-f8d3622bd49b req-253dd634-70c9-40fa-bea8-194781bc5625 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334658 May 25 16:23:12.799388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-46380a23-24c7-4bcf-a2dd-feee0313be09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:12.800881 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-46380a23-24c7-4bcf-a2dd-feee0313be09 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1096 time: 0.0750327 May 25 16:23:12.940817 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-5c37f3a8-5ddb-4920-85ce-d1938168e8db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:12.942158 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-5c37f3a8-5ddb-4920-85ce-d1938168e8db service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1334295 May 25 16:23:13.030198 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-cee203ff-f7ff-4fcc-8ebe-ee230ccb74a4 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 200 len: 217 time: 0.0670462 May 25 16:23:13.104828 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-6bb9f873-6f99-48f8-8622-3b5ae3ae87e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:13.106120 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-6bb9f873-6f99-48f8-8622-3b5ae3ae87e3 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0683644 May 25 16:23:13.191463 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-aa27cedc-58dd-447b-be25-ffd4b0a0113c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:13.192881 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-aa27cedc-58dd-447b-be25-ffd4b0a0113c service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0760853 May 25 16:23:13.359331 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-06475ef1-a800-4020-9c11-e58f6961adad service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1547086 May 25 16:23:13.611403 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03d9e42e-bcae-47a3-931c-d8d003345a17 req-5c1458cf-747b-4cab-8576-25d2a7c652f9 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2445915 May 25 16:23:13.819397 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc978e96-dac3-4128-84d5-8f5a64285a6c req-6ef0bb9d-9b25-403c-bda3-4085a3cbd337 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:13.820995 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fc978e96-dac3-4128-84d5-8f5a64285a6c req-6ef0bb9d-9b25-403c-bda3-4085a3cbd337 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.0952024 May 25 16:23:13.874412 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fc978e96-dac3-4128-84d5-8f5a64285a6c req-a0ac96ff-91d6-4d14-9175-c260c4f3652b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476635 May 25 16:23:15.097049 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f64451-adc2-470a-84a0-c13f274a2024 req-96c31c9d-c003-439d-94b1-0f84d8254d41 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:15.098707 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a5f64451-adc2-470a-84a0-c13f274a2024 req-96c31c9d-c003-439d-94b1-0f84d8254d41 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.1080308 May 25 16:23:15.151625 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a5f64451-adc2-470a-84a0-c13f274a2024 req-c8aeb7bb-73b0-4619-b2df-9053c8f626c5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450063 May 25 16:23:16.355393 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ca69be4-2c25-4af3-8ceb-a47921ce6b08 req-bda7945c-e8e7-4cb8-b51f-3d221ba9a6ec tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:16.357020 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5ca69be4-2c25-4af3-8ceb-a47921ce6b08 req-bda7945c-e8e7-4cb8-b51f-3d221ba9a6ec tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.0908611 May 25 16:23:16.405480 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-5ca69be4-2c25-4af3-8ceb-a47921ce6b08 req-8f4d9bc4-bc9b-4316-8e73-c32f19a4e523 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424862 May 25 16:23:17.609758 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711d1b48-bcb0-4a0b-a610-40aaf0a8a168 req-87d8dc6a-16aa-4458-b8df-83f054593e40 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:17.611292 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-711d1b48-bcb0-4a0b-a610-40aaf0a8a168 req-87d8dc6a-16aa-4458-b8df-83f054593e40 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.0887766 May 25 16:23:17.670406 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-711d1b48-bcb0-4a0b-a610-40aaf0a8a168 req-e000426d-9cef-4d5b-a61b-dc475a2b6d80 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519550 May 25 16:23:18.899516 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-3bb53512-31b9-4cb1-b8b7-504fcd89955f service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1683211 May 25 16:23:18.938257 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e44a4d3-3a45-4ae2-9e79-569d7509b5b3 req-6ddde9a3-f91e-4bba-9a48-1ac44e8c179c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:18.940880 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9e44a4d3-3a45-4ae2-9e79-569d7509b5b3 req-6ddde9a3-f91e-4bba-9a48-1ac44e8c179c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 943 time: 0.1008668 May 25 16:23:19.009981 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9e44a4d3-3a45-4ae2-9e79-569d7509b5b3 req-7c5171c0-ef03-4023-95be-f0e37ecfabc3 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580640 May 25 16:23:19.101798 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a256500d-9951-4606-8de2-9caeb5eee462 req-0dac26be-f5b2-4429-8a19-89d0e9d2b1c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:19.103315 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-0dac26be-f5b2-4429-8a19-89d0e9d2b1c6 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.0924802 May 25 16:23:19.337487 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a256500d-9951-4606-8de2-9caeb5eee462 req-a38a1734-bfbd-4133-810f-e102791bcdcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:19.338932 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-a38a1734-bfbd-4133-810f-e102791bcdcb service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2122631 May 25 16:23:19.466146 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-ac95c642-8c7a-46ff-b17c-b081a8f10874 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 1001 time: 0.1203437 May 25 16:23:19.540060 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a256500d-9951-4606-8de2-9caeb5eee462 req-230fec18-5509-497c-97eb-b8444d5bdf1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:19.541523 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-230fec18-5509-497c-97eb-b8444d5bdf1a service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0663598 May 25 16:23:19.550651 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device caa23432-9fd8-412a-9f4a-97bbeceea7c6 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=98393) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:23:19.668942 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a256500d-9951-4606-8de2-9caeb5eee462 req-a7e164d7-e9d1-49e7-afea-174f52f065c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:19.671288 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-a7e164d7-e9d1-49e7-afea-174f52f065c0 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1150796 May 25 16:23:19.729638 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:23:19.747350 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Returning: {'device': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'port_id': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'mac_address': 'fa:16:3e:69:b5:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 828, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98393) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:23:19.831886 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:19.842644 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-c0463bda-5bfa-438c-8647-125cd81e0abe service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1634448 May 25 16:23:19.858095 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id caa23432-9fd8-412a-9f4a-97bbeceea7c6 {{(pid=98393) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:23:19.883942 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:23:19.894232 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:19.897533 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:19.989086 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=4']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:20.001072 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.001822 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.002133 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.002749 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.003324 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.003826 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.004230 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.004682 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.005175 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.005644 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.006148 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.006603 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:23:20.009305 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a256500d-9951-4606-8de2-9caeb5eee462 req-eacdd71e-00e4-4e94-93bd-c467d63f1681 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1590323 May 25 16:23:20.010949 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:20.241461 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] get_ports_and_sgs() called for port_ids ['caa23432-9fd8-412a-9f4a-97bbeceea7c6'] {{(pid=98393) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:23:20.257366 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9896d63-502a-404b-aa1e-050ccfbef428 req-7548c879-2c7e-4119-8273-cdda81f6fcf9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:20.258931 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d9896d63-502a-404b-aa1e-050ccfbef428 req-7548c879-2c7e-4119-8273-cdda81f6fcf9 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 944 time: 0.0921266 May 25 16:23:20.341942 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d9896d63-502a-404b-aa1e-050ccfbef428 req-4e858616-52e8-4b3d-a4ca-8934aed327fd tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0742893 May 25 16:23:21.554417 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device caa23432-9fd8-412a-9f4a-97bbeceea7c6 up at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:23:21.590924 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84093443-6779-454c-a86e-b66757b9bae7 req-2c9c1503-ebd7-4c46-a5ad-112ec63b0902 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:21.592479 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-84093443-6779-454c-a86e-b66757b9bae7 req-2c9c1503-ebd7-4c46-a5ad-112ec63b0902 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 944 time: 0.1160510 May 25 16:23:21.657737 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning for port caa23432-9fd8-412a-9f4a-97bbeceea7c6 completed by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:23:21.660133 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-84093443-6779-454c-a86e-b66757b9bae7 req-70536740-a7dd-40bf-87a9-41ce3e3fcb4d tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0562735 May 25 16:23:21.663931 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.provisioning_blocks [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Provisioning complete for port caa23432-9fd8-412a-9f4a-97bbeceea7c6 triggered by entity L2. {{(pid=98393) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:23:21.664292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1710653'] for port, provisioning_complete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:21.812839 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:21.888956 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6'}] {{(pid=98393) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:23:21.900852 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:23:21.915291 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846'] for port, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:21.920292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:21.964394 dv-cinder-786383-6-iscsi neutron-server[98393]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'code': 200} May 25 16:23:22.021835 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Pushing event updated for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=5']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:22.025249 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:22.298759 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279734bb-5fc0-4d1d-99c1-c8f96139bf76 req-e534f82e-3b45-4d5c-85e6-c7192ae073e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:22.300285 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-279734bb-5fc0-4d1d-99c1-c8f96139bf76 req-e534f82e-3b45-4d5c-85e6-c7192ae073e2 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1098 time: 0.0849087 May 25 16:23:22.357595 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-279734bb-5fc0-4d1d-99c1-c8f96139bf76 req-2bcd8be6-a68b-4a3e-921e-58b4336d2dd0 service neutron] 10.222.0.74 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454972 May 25 16:23:22.962052 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96eda59-ea3c-485e-8a27-4ef4309c48f8 req-acc4b9a1-c010-46f1-a8e6-29570b1fb9fc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:22.963513 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d96eda59-ea3c-485e-8a27-4ef4309c48f8 req-acc4b9a1-c010-46f1-a8e6-29570b1fb9fc tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.1895890 May 25 16:23:23.010680 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d96eda59-ea3c-485e-8a27-4ef4309c48f8 req-911d7d69-53fd-4655-82ed-7014b8a9e288 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414307 May 25 16:23:24.208057 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9304b49c-d5ad-40d6-a958-2a3f11342f30 req-24e077ed-24bd-4fcb-b53b-9c77b1bd2de1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:24.209750 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9304b49c-d5ad-40d6-a958-2a3f11342f30 req-24e077ed-24bd-4fcb-b53b-9c77b1bd2de1 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.0863614 May 25 16:23:24.263274 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-9304b49c-d5ad-40d6-a958-2a3f11342f30 req-a06b3365-c916-42ce-b358-664d2f730daa tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474715 May 25 16:23:24.441885 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:23:24.478589 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9c9a09-b62e-487e-95a3-8d7c7965a3d3 req-cf0e2ccf-c59d-4551-ab8d-87db0ac2ab37 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:24.479981 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b9c9a09-b62e-487e-95a3-8d7c7965a3d3 req-cf0e2ccf-c59d-4551-ab8d-87db0ac2ab37 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.0969570 May 25 16:23:24.529312 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1b9c9a09-b62e-487e-95a3-8d7c7965a3d3 req-f72828b0-ce3c-4d03-964e-da05636d68e2 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432472 May 25 16:23:24.561925 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56616) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:23:24.646376 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4b806e4-9391-4132-a6cb-fde4466c1306 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98391) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:24.648790 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-c4b806e4-9391-4132-a6cb-fde4466c1306 tempest-TestVolumeBootPattern-580992213 tempest-TestVolumeBootPattern-580992213-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1093 time: 0.0856104 May 25 16:23:24.652350 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56620) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:23:24.667232 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.v2.base [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Request body: {'floatingip': {'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'port_id': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address': '172.20.0.3'}} {{(pid=98392) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:23:24.677681 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:23:24.682365 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Usage tracker for resource:floatingip and tenant:a899ba7d8bc0472caa53a2e65d1bd7ea is out of sync, need to count used quota {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:23:24.685549 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=98392) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:23:24.695212 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.quota.driver [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=98392) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:23:24.706971 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:24.881560 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:25.097630 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_common [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Allocated IP 172.27.1.14 (dd24df8c-53ac-4808-8523-828ba13af2df/719fe799-49f6-4160-98fd-c7cb57ccb76d/6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4) {{(pid=98392) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:23:25.295178 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:25.336925 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8792484333011', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:25.340755 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-7efb3785-c75b-4efe-9ea1-cd8b1d2a07be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:25.408207 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Network dd24df8c-53ac-4808-8523-828ba13af2df is already hosted by enough agents. {{(pid=98392) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:23:25.411319 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.base_scheduler [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Resources bound (agent type, host, resource id): {{(pid=98392) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:23:25.415371 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Received port after_create {{(pid=98392) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:23:25.444830 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4,revision_number=1']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:25.451252 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:25.900453 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:25.991114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1623307'] for port, before_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:26.297712 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for port, precommit_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:26.305129 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8792484766868', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8792484333029', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8792484333846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3358655'] for port, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:26.311219 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ad880749-defd-409b-bd77-396a8097d736 tempest-AttachVolumeNegativeTest-1109508981 tempest-AttachVolumeNegativeTest-1109508981-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:23:26.459580 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event updated for resources: {'Port': ['ID=6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4,revision_number=2']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:23:26.465909 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:23:26.475798 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-408089'] for floatingip, after_update {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:26.825903 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP ec008e4a-4102-4dcb-93bf-6f694cab59d7 associated. External IP: 172.27.1.14, port: caa23432-9fd8-412a-9f4a-97bbeceea7c6. May 25 16:23:27.260337 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:23:27.471130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:23:27.485262 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:23:27.500042 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:23:27.500974 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:23:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:23:27.505408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:27.581167 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-9652e58b-4e08-43d6-9f75-5c5e92bc4d9c tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.9273224 May 25 16:23:27.581963 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:23:27.655476 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'status': 'completed', 'code': 200} May 25 16:23:27.756383 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:23:27.800408 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-0d116de2-b83c-48ae-904c-a4bd64f0cfc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:27.802482 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-0d116de2-b83c-48ae-904c-a4bd64f0cfc8 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1098 time: 0.0957079 May 25 16:23:27.983289 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-ed2a3461-f6ba-4d5c-a22e-13af6ecef3b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:27.985851 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-ed2a3461-f6ba-4d5c-a22e-13af6ecef3b2 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1767201 May 25 16:23:28.135045 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-45886a7d-f903-42e0-a666-9c9a8c475706 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 200 len: 998 time: 0.1418853 May 25 16:23:28.232668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-57a50a9a-27b4-4ce6-956f-55621e0161c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:28.234879 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-57a50a9a-27b4-4ce6-956f-55621e0161c1 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0932825 May 25 16:23:28.262167 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}, {'id': 'ec008e4a-4102-4dcb-93bf-6f694cab59d7', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.14', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:69:b5:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:23:25Z', 'updated_at': '2021-05-25T16:23:25Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:23:28.269746 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:23:28.284933 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:23:28.285696 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:23:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:23:28.377730 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-84a49d90-0499-448d-98fd-1bf63b978d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:23:28.379802 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-84a49d90-0499-448d-98fd-1bf63b978d24 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1365979 May 25 16:23:28.540021 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:23:28.669157 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-79aac5eb-ae67-4aec-91e8-b628c3f3c4cb service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2813923 May 25 16:23:28.899528 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-1e207fc2-7942-4eb2-aec4-68edd82f590d req-e94be475-79f3-425e-a7a6-63db8beb03f7 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2234530 May 25 16:23:29.008634 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}, {'id': 'ec008e4a-4102-4dcb-93bf-6f694cab59d7', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.14', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:69:b5:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:23:25Z', 'updated_at': '2021-05-25T16:23:25Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:23:29.022204 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ed965a6-0475-4762-9376-873c6d7aa532 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}, {'id': 'ec008e4a-4102-4dcb-93bf-6f694cab59d7', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.14', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:69:b5:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:23:25Z', 'updated_at': '2021-05-25T16:23:25Z', 'revision_number': 0, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:23:29.235735 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b635c9d6-3093-4205-9b84-8b44f37569dd None None] New status for floating IP ec008e4a-4102-4dcb-93bf-6f694cab59d7: ACTIVE {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:23:29.267973 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-0964a5ba-6425-49b8-badd-6b731fd9694c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:31.612558 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:31.799424 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bdf8341d-9e9e-43e0-8737-fb3797fd2eca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:32.922769 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:34.641100 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:36.392317 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:23:59.262674 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-3d3364b5-74ef-4115-b448-36bd41c93c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:01.441775 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:24:01.606435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:01.801741 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-bd8f73f0-9ab1-4430-9ba0-6c909a340e06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:02.922965 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:04.638060 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:06.376313 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:19.939147 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-412af3f6-2a6a-4669-af76-5081b7356191 service neutron] 10.222.0.74 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1949162 May 25 16:24:20.112364 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-78379665-090a-4563-98c3-5f8f820af03f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:20.113995 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-78379665-090a-4563-98c3-5f8f820af03f service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.0859725 May 25 16:24:20.265722 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-b649aaf1-edf4-48a1-be20-b87d4b6cf8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:20.267204 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-b649aaf1-edf4-48a1-be20-b87d4b6cf8bf service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1330917 May 25 16:24:20.368395 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-b5ea8600-5535-48e8-aa68-6cf86e1fd993 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 1001 time: 0.0941129 May 25 16:24:20.433950 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-51736cdc-11e5-4acd-9d42-b15dc62929e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:20.435358 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-51736cdc-11e5-4acd-9d42-b15dc62929e9 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0606298 May 25 16:24:20.512348 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-3ba68f0d-a319-4b00-aac7-e79607b5af67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:20.513804 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-3ba68f0d-a319-4b00-aac7-e79607b5af67 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0718353 May 25 16:24:20.652377 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-d961f7cd-e432-4a85-bf37-a6dd858f78c1 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307454 May 25 16:24:20.796857 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d3aaa83e-61df-4e23-9efe-0c87f371b567 req-11a64a88-2f33-429c-accb-bec861a4b88f service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1377397 May 25 16:24:29.266155 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-5b07eef1-6fff-4dcc-bb2e-42f592388a0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:31.613889 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:31.815510 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d4c019b0-0186-4480-afb1-93bfb5babf7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:32.926254 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:34.646215 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:36.387476 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:38.440972 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:24:55.588395 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56654) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:24:55.877569 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port 6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:24:55.877804 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:56.002766 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:56.003087 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:56.131104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for 6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4 owned by network:floatingip {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:24:56.372060 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:56.375953 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:24:56.423699 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=6d8cb5ce-8a61-4e26-9db9-b124fbb25ac4,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:24:56.462300 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.462688 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.463069 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.463437 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.463843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.464208 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.464590 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.464929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.465287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.465642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.465991 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.466344 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98392) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:24:56.474456 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:24:56.532779 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:56.533111 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP ec008e4a-4102-4dcb-93bf-6f694cab59d7 disassociated (deleted). External IP: 172.27.1.14, port: caa23432-9fd8-412a-9f4a-97bbeceea7c6. May 25 16:24:56.929126 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:24:57.115602 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:24:57.125684 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:24:57.137719 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:57.142136 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:24:57.142992 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:24:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:24:57.204321 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-af95819e-d291-405f-b217-7818bafd2687 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "DELETE /v2.0/floatingips/ec008e4a-4102-4dcb-93bf-6f694cab59d7 HTTP/1.1" status: 204 len: 168 time: 1.6147945 May 25 16:24:57.205226 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:24:57.326417 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'status': 'completed', 'code': 200} May 25 16:24:57.335183 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:24:57.464987 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-8eaa2169-1246-4b82-9b88-8e1efa4a96fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:57.466458 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-8eaa2169-1246-4b82-9b88-8e1efa4a96fb service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 1098 time: 0.0892899 May 25 16:24:57.653012 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-6f737180-a343-4594-94e5-a124f00e9893 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:57.654017 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-6f737180-a343-4594-94e5-a124f00e9893 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.1612074 May 25 16:24:57.753247 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:24:57.757347 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:24:57.766781 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:24:57.767413 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:24:32Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:24:57.792933 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-f2c53e60-93f7-42f9-b799-d8b688ee3181 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 200 len: 217 time: 0.1316674 May 25 16:24:57.874733 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-6ffdb2e7-8a87-4353-b663-b974aa8c1b38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:57.876171 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-6ffdb2e7-8a87-4353-b663-b974aa8c1b38 service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0673249 May 25 16:24:57.931809 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf205e4-9484-4ba8-b706-5cf5a23747da req-e2e2b241-e868-462f-b294-25bcde82f47a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:57.932673 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-bcf205e4-9484-4ba8-b706-5cf5a23747da req-e2e2b241-e868-462f-b294-25bcde82f47a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:24:57.960101 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:24:57.965556 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-bcf205e4-9484-4ba8-b706-5cf5a23747da req-e2e2b241-e868-462f-b294-25bcde82f47a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:24:57.966712 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcf205e4-9484-4ba8-b706-5cf5a23747da req-e2e2b241-e868-462f-b294-25bcde82f47a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.3985634 May 25 16:24:58.016683 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-d358966f-2b8b-4b30-97aa-851da594ee45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:58.019131 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-d358966f-2b8b-4b30-97aa-851da594ee45 service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1336629 May 25 16:24:58.034938 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-bcf205e4-9484-4ba8-b706-5cf5a23747da req-5d93638a-e13a-497a-bab2-dfbeb5f37f69 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0601778 May 25 16:24:58.420293 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:24:58.427839 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f4aa2d7-56d9-42cc-b064-858249977e40 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_floatingips': [{'id': '22e50bf4-0fe7-46a1-bab8-761c52ebf705', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'floating_ip_address': '172.27.1.154', 'floating_network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'router_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'port_id': '73688523-f562-4269-bd2c-3389c0751537', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 679, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'mac_address': 'fa:16:3e:66:57:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:21:28Z', 'updated_at': '2021-05-25T16:21:31Z', 'revision_number': 1, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:24:58.437812 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-9fb7fe32-6921-4ded-9622-6a831f7ac096 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4087124 May 25 16:24:58.637711 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-44ac74e5-b59c-488c-812b-5d7c42914551 req-83074fd0-5c5c-40fd-a662-f2256d8fd6d5 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1919017 May 25 16:24:58.706492 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f751c155-5e2f-4a3f-b8ba-c82a9bb2c273 None None] New status for floating IP ec008e4a-4102-4dcb-93bf-6f694cab59d7: DOWN {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:24:59.269069 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-4fa827a8-ddf7-4479-b0c3-8493472b8273 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:59.303195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f981342-aef6-49b8-a7de-4cb95973968d req-290b13ad-38eb-41ea-9f40-0c7b4b790980 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:59.304709 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0f981342-aef6-49b8-a7de-4cb95973968d req-290b13ad-38eb-41ea-9f40-0c7b4b790980 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.1404803 May 25 16:24:59.385395 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-0f981342-aef6-49b8-a7de-4cb95973968d req-5e478821-4007-4031-9b99-e3158853c3d8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0750544 May 25 16:24:59.431065 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-35e4ec93-d953-4d67-b81d-5c26a00ecca5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:24:59.432425 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-35e4ec93-d953-4d67-b81d-5c26a00ecca5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 945 time: 0.0879149 May 25 16:24:59.591863 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port caa23432-9fd8-412a-9f4a-97bbeceea7c6 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:24:59.592182 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:59.754256 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] For port caa23432-9fd8-412a-9f4a-97bbeceea7c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=caa23432-9fd8-412a-9f4a-97bbeceea7c6,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:24:59.754511 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:24:59.902797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for caa23432-9fd8-412a-9f4a-97bbeceea7c6 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:00.032763 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:00.039331 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-d77cd19d-cf06-445e-864d-f23443a14f07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:00.086889 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=caa23432-9fd8-412a-9f4a-97bbeceea7c6,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:00.114096 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:00.165219 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] No DVR routers for this DVR port caa23432-9fd8-412a-9f4a-97bbeceea7c6 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:00.167931 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:00.170526 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'name': 'network-vif-deleted', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:25:00.187176 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-e5abcbc3-36f7-4112-a192-8ac96db4a7df req-04db0bf3-d2ac-4d03-823e-61b82c829972 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "DELETE /v2.0/ports/caa23432-9fd8-412a-9f4a-97bbeceea7c6 HTTP/1.1" status: 204 len: 173 time: 0.7485366 May 25 16:25:00.218791 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98690939-27cc-41f7-a78f-e3d40248e1dc', 'name': 'network-vif-deleted', 'tag': 'caa23432-9fd8-412a-9f4a-97bbeceea7c6', 'status': 'completed', 'code': 200} May 25 16:25:00.549671 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-fdbffdfa-42ce-43c7-90cc-fd3959d20b9a req-1377d17e-41dc-410f-acf0-eeb22d545cdb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:25:00.570131 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-fdbffdfa-42ce-43c7-90cc-fd3959d20b9a req-1377d17e-41dc-410f-acf0-eeb22d545cdb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:25:00.572193 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-fdbffdfa-42ce-43c7-90cc-fd3959d20b9a req-1377d17e-41dc-410f-acf0-eeb22d545cdb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=98690939-27cc-41f7-a78f-e3d40248e1dc HTTP/1.1" status: 200 len: 210 time: 0.0740356 May 25 16:25:01.609615 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:01.813420 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-013080db-5a1b-4346-821f-c98f67e2a4f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:02.130466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device caa23432-9fd8-412a-9f4a-97bbeceea7c6 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:02.171091 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: caa23432-9fd8-412a-9f4a-97bbeceea7c6 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:02.171443 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device caa23432-9fd8-412a-9f4a-97bbeceea7c6 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:02.932176 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.216433 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56694) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:04.488042 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port 07114f7c-0fdb-4700-837f-4e5d52f76414 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:04.488287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.609527 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.609852 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.643963 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.834402 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for 07114f7c-0fdb-4700-837f-4e5d52f76414 owned by network:floatingip {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:04.968887 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:04.974041 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-15f217f3-5698-4181-bc2b-f7cd0ae78270 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:05.030453 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=07114f7c-0fdb-4700-837f-4e5d52f76414,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:05.034143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:05.126970 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:05.127192 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.db.l3_db [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Floating IP 22e50bf4-0fe7-46a1-bab8-761c52ebf705 disassociated (deleted). External IP: 172.27.1.154, port: 73688523-f562-4269-bd2c-3389c0751537. May 25 16:25:05.502046 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:25:05.687287 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:25:05.696566 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:25:05.707037 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:05.707725 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:05.708552 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:05.772194 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-99e65cd8-59da-4bcb-bd39-48906644323b tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "DELETE /v2.0/floatingips/22e50bf4-0fe7-46a1-bab8-761c52ebf705 HTTP/1.1" status: 204 len: 168 time: 1.5546205 May 25 16:25:05.772993 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:25:05.831027 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'tag': '73688523-f562-4269-bd2c-3389c0751537', 'status': 'completed', 'code': 200} May 25 16:25:05.957553 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-9a9f4813-567f-4c20-afa2-8d43e78db1c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:05.959630 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-9a9f4813-567f-4c20-afa2-8d43e78db1c4 service neutron] 10.222.0.74 "GET /v2.0/ports?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 1098 time: 0.0825453 May 25 16:25:05.965571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:06.172024 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-3a6c9c73-dd2d-41d9-9e73-c12a911309b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:06.173476 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-3a6c9c73-dd2d-41d9-9e73-c12a911309b8 service neutron] 10.222.0.74 "GET /v2.0/networks?id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 200 len: 912 time: 0.2050927 May 25 16:25:06.261030 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-1a221c2d-f8f9-4230-9a5e-092d96187f49 service neutron] 10.222.0.74 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 200 len: 217 time: 0.0806510 May 25 16:25:06.329060 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a60bcea9-16cd-4dfc-9cb0-646c92e2d9f2 req-a15bcf3e-5e90-4ac4-bc94-f58dda9ee4e5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:06.329695 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-a60bcea9-16cd-4dfc-9cb0-646c92e2d9f2 req-a15bcf3e-5e90-4ac4-bc94-f58dda9ee4e5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:25:06.330831 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:06.335867 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:25:06.344847 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:06.345206 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-e0a19741-e6ac-4431-9816-9614cae56aff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:06.345466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:06.346619 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-e0a19741-e6ac-4431-9816-9614cae56aff service neutron] 10.222.0.74 "GET /v2.0/subnets?id=659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 200 len: 850 time: 0.0776536 May 25 16:25:06.443581 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:06.504122 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-a60bcea9-16cd-4dfc-9cb0-646c92e2d9f2 req-a15bcf3e-5e90-4ac4-bc94-f58dda9ee4e5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:25:06.506616 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a60bcea9-16cd-4dfc-9cb0-646c92e2d9f2 req-a15bcf3e-5e90-4ac4-bc94-f58dda9ee4e5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.4007719 May 25 16:25:06.554014 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:06.570905 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-a60bcea9-16cd-4dfc-9cb0-646c92e2d9f2 req-00e810d9-3491-47c7-8734-9fb979b44221 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0573406 May 25 16:25:06.593024 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-4c0d0085-532c-4d92-b6e9-8cba27985ace service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:06.593024 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-4c0d0085-532c-4d92-b6e9-8cba27985ace service neutron] 10.222.0.74 "GET /v2.0/ports?network_id=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2306011 May 25 16:25:06.725702 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-92d55a2e-258d-4482-b594-7e3d68fce1d5 service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311409 May 25 16:25:06.866162 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-c13be79c-3a65-4a83-b65a-931d30e3c339 req-d08dcd93-37f3-413a-992b-56baa8dcf76c service neutron] 10.222.0.74 "GET /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315305 May 25 16:25:06.877218 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:06.882261 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e414e6a-33b2-4649-842e-415f6f4a6c78 None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:18:00Z', 'revision_number': 4, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi', '_interfaces': [{'id': '63bb2503-8a40-4c99-a763-b687d4db1c08', 'name': '', 'network_id': '0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'mac_address': 'fa:16:3e:65:0e:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_interface', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:59Z', 'updated_at': '2021-05-25T16:18:07Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'subnets': [{'id': '659f33e2-068d-40bb-84cc-c31f8933e023', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:25:07.093611 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3fe453b-6f4b-4576-a848-0dce164749b3 None None] New status for floating IP 22e50bf4-0fe7-46a1-bab8-761c52ebf705: DOWN {{(pid=98394) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 16:25:07.764953 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d56c35b7-1e7b-42d6-9bd5-017ed8a513b7 req-11cb9c71-9bb7-4587-8a53-86044e7b9e59 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:07.766409 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d56c35b7-1e7b-42d6-9bd5-017ed8a513b7 req-11cb9c71-9bb7-4587-8a53-86044e7b9e59 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.0853770 May 25 16:25:07.856264 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-d56c35b7-1e7b-42d6-9bd5-017ed8a513b7 req-26e9a434-af23-49a0-836a-12521efcca1a tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/security-groups?id=a5265a9e-7809-4275-93e5-3ff80a9af0d2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0833516 May 25 16:25:07.891705 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03343717-bfaa-4f06-8831-522231f15054 req-8164323d-e10b-48a6-9640-2943eb31d07d tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98392) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:25:07.893099 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03343717-bfaa-4f06-8831-522231f15054 req-8164323d-e10b-48a6-9640-2943eb31d07d tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 945 time: 0.0926099 May 25 16:25:08.033741 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port 73688523-f562-4269-bd2c-3389c0751537 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:08.034085 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:08.171068 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] For port 73688523-f562-4269-bd2c-3389c0751537, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=73688523-f562-4269-bd2c-3389c0751537,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:08.171329 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:08.296531 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for 73688523-f562-4269-bd2c-3389c0751537 owned by compute:nova {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:08.413669 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:08.419565 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-931b9e8d-4483-4e13-8678-848cd825c8d5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:08.467221 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=73688523-f562-4269-bd2c-3389c0751537,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:08.470286 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:08.547754 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] No DVR routers for this DVR port 73688523-f562-4269-bd2c-3389c0751537 on host hv-cinder-78638 {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:08.550555 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for port, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:08.553989 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'name': 'network-vif-deleted', 'tag': '73688523-f562-4269-bd2c-3389c0751537'}] {{(pid=98392) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:25:08.576525 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-03343717-bfaa-4f06-8831-522231f15054 req-dfe5ccf6-3cab-42b9-a588-189f4b8f7265 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.74 "DELETE /v2.0/ports/73688523-f562-4269-bd2c-3389c0751537 HTTP/1.1" status: 204 len: 173 time: 0.6770618 May 25 16:25:08.602412 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43e892c0-40d0-4de3-a9fc-0c5670a51138', 'name': 'network-vif-deleted', 'tag': '73688523-f562-4269-bd2c-3389c0751537', 'status': 'completed', 'code': 200} May 25 16:25:09.037942 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-cecbfaf9-b3ac-4bbd-b9f6-4e4b52806589 req-cea7c694-651b-4139-864c-677aaef87f74 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Synchronizing usage tracker for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:25:09.055341 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.quota.resource [req-cecbfaf9-b3ac-4bbd-b9f6-4e4b52806589 req-cea7c694-651b-4139-864c-677aaef87f74 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Unset dirty status for tenant:a899ba7d8bc0472caa53a2e65d1bd7ea on resource:port {{(pid=98392) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:25:09.056615 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [req-cecbfaf9-b3ac-4bbd-b9f6-4e4b52806589 req-cea7c694-651b-4139-864c-677aaef87f74 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "GET /v2.0/ports?device_id=43e892c0-40d0-4de3-a9fc-0c5670a51138 HTTP/1.1" status: 200 len: 210 time: 0.0717065 May 25 16:25:10.143963 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73688523-f562-4269-bd2c-3389c0751537 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:10.153994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56712) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:10.183244 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] No Port match for: 73688523-f562-4269-bd2c-3389c0751537 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:10.183609 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Device 73688523-f562-4269-bd2c-3389c0751537 not bound to the agent host hv-cinder-78638 {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:10.372913 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Deleting port 4a1608f7-1cbe-4873-a103-caa1b9e3473c {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:10.373411 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:10.598007 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:10.598388 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:10.722072 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Calling delete_port for 4a1608f7-1cbe-4873-a103-caa1b9e3473c owned by network:floatingip {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:10.851169 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:10.855672 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-07df51cb-5832-409f-9270-249d005eead5 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:10.900335 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'Port': ['ID=4a1608f7-1cbe-4873-a103-caa1b9e3473c,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:10.926850 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:10.999244 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for floatingip, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:11.017950 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1960731'] for floatingip, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:11.019114 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-ed7bae1c-735d-40d7-8f52-7756da1ef444 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "DELETE /v2.0/floatingips/3e834328-ccb9-401f-896a-5282f31c7863 HTTP/1.1" status: 204 len: 168 time: 0.8641469 May 25 16:25:12.401763 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56726) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:12.470882 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:12.501500 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:12.568843 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:12.572914 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6b9cb070-3086-414c-8f68-1ebbd4db7ba0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:12.589797 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5265a9e-7809-4275-93e5-3ff80a9af0d2,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:12.592951 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:12.606484 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Notify callbacks [] for security_group, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:12.608416 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-bcf0a175-a405-4d5f-b5a2-398622f50ebb tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] 10.222.0.25 "DELETE /v2.0/security-groups/a5265a9e-7809-4275-93e5-3ff80a9af0d2 HTTP/1.1" status: 204 len: 168 time: 0.2054212 May 25 16:25:12.670903 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56732) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:13.349883 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:13.891970 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Deleting port 63bb2503-8a40-4c99-a763-b687d4db1c08 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:13.892727 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:14.031978 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] For port 63bb2503-8a40-4c99-a763-b687d4db1c08, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=63bb2503-8a40-4c99-a763-b687d4db1c08,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:14.032337 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:14.160938 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Calling delete_port for 63bb2503-8a40-4c99-a763-b687d4db1c08 owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:14.334380 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:14.338668 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-404ea996-0cc8-4d35-833a-1a2c1a48fdcf tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:14.383941 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Pushing event deleted for resources: {'Port': ['ID=63bb2503-8a40-4c99-a763-b687d4db1c08,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:14.386898 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:14.664328 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:15.034929 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Router a7599ba5-2a61-4148-b2df-718c47f35d9f has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:25:15.221267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:25:15.229859 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Sync routers for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:25:15.235523 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-26b72e55-10aa-4909-aef3-bf7e7efb5d2e admin admin] 10.222.0.25 "PUT /v2.0/routers/a7599ba5-2a61-4148-b2df-718c47f35d9f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5613010 May 25 16:25:15.235771 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56738) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:15.239514 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:15.240167 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:15.424792 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: dv-cinder-786383-6-iscsi {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:15.440642 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:25:15.514623 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:15.705673 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:15.781501 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207'}], 'enable_snat': True}, 'gw_port_id': '1de33510-909d-4188-99b8-31e897566ed1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:25:14Z', 'revision_number': 5, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port': {'id': '1de33510-909d-4188-99b8-31e897566ed1', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:22:1c:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 605, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:17:56Z', 'updated_at': '2021-05-25T16:18:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:15.785661 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Checking router: a7599ba5-2a61-4148-b2df-718c47f35d9f for host: dv-cinder-786383-6-iscsi {{(pid=98393) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:25:15.786568 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Deleting port 1de33510-909d-4188-99b8-31e897566ed1 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:15.786912 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:15.795481 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Routers {'a7599ba5-2a61-4148-b2df-718c47f35d9f'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98393) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:15.796173 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['a7599ba5-2a61-4148-b2df-718c47f35d9f'], 'active': True} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:15.920106 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] For port 1de33510-909d-4188-99b8-31e897566ed1, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=1de33510-909d-4188-99b8-31e897566ed1,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:15.920467 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:15.955315 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvr_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] Set router a7599ba5-2a61-4148-b2df-718c47f35d9f gateway port host: None {{(pid=98393) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:16.054094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Calling delete_port for 1de33510-909d-4188-99b8-31e897566ed1 owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:16.061802 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_hamode_db [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:25:15Z', 'revision_number': 6, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98393) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:16.066548 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0467c64b-7a04-47ba-8274-bc86eeb4cecf None None] The sync data for ids ['a7599ba5-2a61-4148-b2df-718c47f35d9f'] in dv-cinder-786383-6-iscsi is: [{'id': 'a7599ba5-2a61-4148-b2df-718c47f35d9f', 'name': 'tempest-TestVolumeBootPattern-882757123-router', 'tenant_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:17:55Z', 'updated_at': '2021-05-25T16:25:15Z', 'revision_number': 6, 'project_id': 'a899ba7d8bc0472caa53a2e65d1bd7ea', 'gw_port_host': None}] {{(pid=98393) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:25:16.197835 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.202104 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-fa6d6b96-67f1-4f21-9718-a750d204ebb8 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:16.248036 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Pushing event deleted for resources: {'Port': ['ID=1de33510-909d-4188-99b8-31e897566ed1,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:16.274386 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:16.336336 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.513638 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.515901 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.546184 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.546796 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Fanout notify agent at l3_agent the message router_deleted on router a7599ba5-2a61-4148-b2df-718c47f35d9f {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:25:16.560201 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.561405 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-0c7c326a-4c6c-4e85-a8c1-7c99533f360a admin admin] 10.222.0.25 "DELETE /v2.0/routers/a7599ba5-2a61-4148-b2df-718c47f35d9f HTTP/1.1" status: 204 len: 168 time: 1.3247099 May 25 16:25:16.564019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56742) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:16.628891 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Deleting subnet 659f33e2-068d-40bb-84cc-c31f8933e023 {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:25:16.632496 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.685193 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:16.764423 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.073524 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 63bb2503-8a40-4c99-a763-b687d4db1c08 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:17.109309 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 63bb2503-8a40-4c99-a763-b687d4db1c08 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:17.109542 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 63bb2503-8a40-4c99-a763-b687d4db1c08 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:17.109970 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1de33510-909d-4188-99b8-31e897566ed1 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:17.129933 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.138200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:17.144292 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 1de33510-909d-4188-99b8-31e897566ed1 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:17.144643 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 1de33510-909d-4188-99b8-31e897566ed1 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:17.178284 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=659f33e2-068d-40bb-84cc-c31f8933e023,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:17.180269 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.182896 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:17.187576 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-19cc4869-4352-4924-b2b2-3a14d07de3e0 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/659f33e2-068d-40bb-84cc-c31f8933e023 HTTP/1.1" status: 204 len: 168 time: 0.6225090 May 25 16:25:17.187925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6d3019e-e27c-47fa-a288-e4c4ed53ef15 None None] Network 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:25:17.190335 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56746) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:17.297877 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.368878 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Deleting port c5fb4dc4-d633-4c33-96fa-3dcace397ddf {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:17.369223 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.455522 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] DHCP port deletion for 0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:25:17.472577 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] For port c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:17.472928 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.522120 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Deleting port c5fb4dc4-d633-4c33-96fa-3dcace397ddf {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:17.522560 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.596450 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Calling delete_port for c5fb4dc4-d633-4c33-96fa-3dcace397ddf owned by network:dhcp {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:17.623268 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] For port c5fb4dc4-d633-4c33-96fa-3dcace397ddf, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,segment=NetworkSegment(9ea9a7f5-8525-4a9d-94f3-311c5943a532),segment_id=9ea9a7f5-8525-4a9d-94f3-311c5943a532)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:17.623867 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.645003 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.649053 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-e668e46b-bf65-4b3d-9845-ce5c2188fcb0 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:17.696490 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Pushing event deleted for resources: {'Port': ['ID=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:17.700159 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:17.702267 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] No DVR routers for this DVR port c5fb4dc4-d633-4c33-96fa-3dcace397ddf on host dv-cinder-786383-6-iscsi {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:17.753861 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Calling delete_port for c5fb4dc4-d633-4c33-96fa-3dcace397ddf owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:17.798978 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.803544 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:17.821678 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.836136 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:17.849518 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ea9a7f5-8525-4a9d-94f3-311c5943a532') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:17.849817 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ea9a7f5-8525-4a9d-94f3-311c5943a532') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:17.851736 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] No DVR routers for this DVR port c5fb4dc4-d633-4c33-96fa-3dcace397ddf on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:17.855374 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Pushing event deleted for resources: {'Port': ['ID=c5fb4dc4-d633-4c33-96fa-3dcace397ddf,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:17.862861 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.864776 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.865166 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.865704 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.865925 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.866215 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.866466 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.866790 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.867159 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.867435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.867785 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.868125 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.868446 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98393) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:17.871800 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-9b43ba40-e798-4441-8611-b3c7f86938a1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:17.881101 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.889130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Releasing vlan 828 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:25:17.889130 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:25:17.902533 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:25:17.985195 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:17.989112 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:18.002642 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:18.012869 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Pushing event deleted for resources: {'Network': ['ID=0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:18.016033 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:18.026762 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-4ace8487-0f0b-4c73-a2fc-f9d317ebfa98 admin admin] 10.222.0.25 "DELETE /v2.0/networks/0882ad79-a9d6-4ab8-bd7b-994f52f5fb2a HTTP/1.1" status: 204 len: 168 time: 0.8354602 May 25 16:25:18.029994 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56750) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:18.675239 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-409131'] for router_interface, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:19.087914 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c5fb4dc4-d633-4c33-96fa-3dcace397ddf no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:19.124192 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Deleting port 64a0d5a5-3221-4b1d-a541-c372770cc636 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:19.124532 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:19.125835 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: c5fb4dc4-d633-4c33-96fa-3dcace397ddf {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:19.125835 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device c5fb4dc4-d633-4c33-96fa-3dcace397ddf not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:19.247979 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] For port 64a0d5a5-3221-4b1d-a541-c372770cc636, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=64a0d5a5-3221-4b1d-a541-c372770cc636,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:19.248332 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:19.374249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Calling delete_port for 64a0d5a5-3221-4b1d-a541-c372770cc636 owned by network:router_interface {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:19.525124 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:19.529273 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-67fafb4f-653b-4619-8ad2-3b669d304bcb tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:19.574965 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=64a0d5a5-3221-4b1d-a541-c372770cc636,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:19.578322 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:19.842714 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587681', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-407227'] for router_interface, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:20.309990 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Router eb166b1f-c9b6-41c0-93f2-1954db943b43 has already been hosted by L3 agent b7106cdd-185e-4799-a3b6-f8d6d63d8db1 {{(pid=98392) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:25:20.489094 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] Notify agent at l3_agent.dv-cinder-786383-6-iscsi the message routers_updated {{(pid=98392) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:25:20.498900 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Sync routers for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:25:20.508873 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-3472fec1-0baa-4dfe-be70-2e18052fb9e7 admin admin] 10.222.0.25 "PUT /v2.0/routers/eb166b1f-c9b6-41c0-93f2-1954db943b43/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4777372 May 25 16:25:20.511625 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56754) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:20.511848 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:20.512356 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:20.696727 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks [] for router, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:20.701903 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: dv-cinder-786383-6-iscsi {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:20.870957 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:20.942947 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Deleting port 913bd645-8ded-4389-a7b8-766f2aa204fb {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:20.943205 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.010300 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'external_fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:25:19Z', 'revision_number': 5, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port': {'id': '913bd645-8ded-4389-a7b8-766f2aa204fb', 'name': '', 'network_id': 'dd24df8c-53ac-4808-8523-828ba13af2df', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:01:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 622, 'fixed_ips': [{'subnet_id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786383-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:18:05Z', 'updated_at': '2021-05-25T16:18:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '719fe799-49f6-4160-98fd-c7cb57ccb76d', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786383-6-iscsi'}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:21.014081 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Checking router: eb166b1f-c9b6-41c0-93f2-1954db943b43 for host: dv-cinder-786383-6-iscsi {{(pid=98394) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:25:21.025587 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Routers {'eb166b1f-c9b6-41c0-93f2-1954db943b43'} bound to L3 agent in host dv-cinder-786383-6-iscsi {{(pid=98394) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:25:21.026212 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-786383-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:33:32Z,description=,heartbeat_timestamp=2021-05-25T16:25:02Z,host='dv-cinder-786383-6-iscsi',id=b7106cdd-185e-4799-a3b6-f8d6d63d8db1,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:33:32Z,topic='l3_agent')) {'router_ids': ['eb166b1f-c9b6-41c0-93f2-1954db943b43'], 'active': True} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:21.068133 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] For port 913bd645-8ded-4389-a7b8-766f2aa204fb, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=913bd645-8ded-4389-a7b8-766f2aa204fb,segment=NetworkSegment(9413c02f-d8ea-4438-b174-b54dd38bccfe),segment_id=9413c02f-d8ea-4438-b174-b54dd38bccfe)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:21.068500 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.178627 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_dvr_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] Set router eb166b1f-c9b6-41c0-93f2-1954db943b43 gateway port host: None {{(pid=98394) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:25:21.196239 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Calling delete_port for 913bd645-8ded-4389-a7b8-766f2aa204fb owned by network:router_gateway {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:21.280551 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.l3_hamode_db [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:25:20Z', 'revision_number': 6, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port_host': None}], 'dv-cinder-786383-6-iscsi', False) {} {{(pid=98394) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:21.284457 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b3ab1bb-d32c-434a-909c-fef8238171f4 None None] The sync data for ids ['eb166b1f-c9b6-41c0-93f2-1954db943b43'] in dv-cinder-786383-6-iscsi is: [{'id': 'eb166b1f-c9b6-41c0-93f2-1954db943b43', 'name': 'tempest-TestVolumeBootPattern-396884191-router', 'tenant_id': '071fa67adcc445f7a4fb235d75abef7c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:18:04Z', 'updated_at': '2021-05-25T16:25:20Z', 'revision_number': 6, 'project_id': '071fa67adcc445f7a4fb235d75abef7c', 'gw_port_host': None}] {{(pid=98394) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:25:21.336019 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.339482 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-0019e755-f0c9-4043-84df-5a9e9851cb88 tempest-TestVolumeBootPattern-1571020210 tempest-TestVolumeBootPattern-1571020210-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:21.485724 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Pushing event deleted for resources: {'Port': ['ID=913bd645-8ded-4389-a7b8-766f2aa204fb,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:21.488725 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:21.577143 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-408118'] for router_gateway, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.757921 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-406459', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2869'] for router, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.760044 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.784200 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-407431'] for router, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.784705 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Fanout notify agent at l3_agent the message router_deleted on router eb166b1f-c9b6-41c0-93f2-1954db943b43 {{(pid=98392) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 16:25:21.797428 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] Notify callbacks [] for router, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.798546 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-6272cdd7-22ff-47e0-9d5d-05077c5185cd admin admin] 10.222.0.25 "DELETE /v2.0/routers/eb166b1f-c9b6-41c0-93f2-1954db943b43 HTTP/1.1" status: 204 len: 168 time: 1.2860098 May 25 16:25:21.801114 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56758) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:21.872661 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.db_base_plugin_v2 [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Deleting subnet 02b1c689-b89a-486d-9043-2b95b5a02dad {{(pid=98392) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:25:21.876831 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:21.941150 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3286862'] for subnet, precommit_delete_associations {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.025007 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1715143'] for subnet, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.283479 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1715826', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053409', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3356741', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3745224'] for subnet, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.287656 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-ff2829d4-1c38-4a13-804a-ae5b69dc1f18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:22.326776 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=02b1c689-b89a-486d-9043-2b95b5a02dad,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:22.329249 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:22.332355 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for subnet, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.337716 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d1146f1-a70a-46ba-9dff-58058bf0d3e6 None None] Network 65e6b112-9bac-41d1-bbe8-8197e6a41377 requested from dv-cinder-786383-6-iscsi {{(pid=98393) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:25:22.339206 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-b4e7eaf1-88aa-4040-b47c-a072e426582e admin admin] 10.222.0.25 "DELETE /v2.0/subnets/02b1c689-b89a-486d-9043-2b95b5a02dad HTTP/1.1" status: 204 len: 168 time: 0.5371399 May 25 16:25:22.341629 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.wsgi [-] (98392) accepted ('10.222.0.25', 56762) {{(pid=98392) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:22.445884 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1655731'] for network, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.518128 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Deleting port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 {{(pid=98392) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:22.518424 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.627136 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.db [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] For port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98392) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:22.627481 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.634942 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] DHCP port deletion for 65e6b112-9bac-41d1-bbe8-8197e6a41377 request from dv-cinder-786383-6-iscsi {{(pid=98393) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 16:25:22.701048 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Deleting port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 {{(pid=98393) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 16:25:22.701428 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8792484765251'] for port, before_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.754942 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.plugin [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Calling delete_port for cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 owned by network:dhcp {{(pid=98392) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:22.802759 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.db [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] For port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6, host dv-cinder-786383-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786383-6-iscsi',level=0,port_id=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,segment=NetworkSegment(84c0121f-ea27-4a7d-a8a0-592be916b665),segment_id=84c0121f-ea27-4a7d-a8a0-592be916b665)] {{(pid=98393) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:25:22.803158 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-408826'] for port, precommit_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.806117 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3358646'] for port, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.809873 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-762073af-6eb0-48b3-892e-b11ac426e1f0 tempest-TestMinimumBasicScenario-1924543602 tempest-TestMinimumBasicScenario-1924543602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:22.854834 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:22.858352 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:22.860943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] No DVR routers for this DVR port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 on host dv-cinder-786383-6-iscsi {{(pid=98392) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:22.929798 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Calling delete_port for cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 owned by network:dhcp {{(pid=98393) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 16:25:22.977910 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1623260', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2053444', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587699', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8792484766886', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8792484333020'] for port, after_delete {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:22.981713 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-d3cf6025-921e-4c00-908a-660729b11665 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:23.031785 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Pushing event deleted for resources: {'Port': ['ID=cf18ab87-678c-4e70-bdd7-eda7cc40ebf6,revision_number=None']} {{(pid=98393) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:23.034217 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG oslo_concurrency.lockutils [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:23.035063 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf61856d-6caa-417d-b5ac-ff14e4e61089 None None] No DVR routers for this DVR port cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 on host dv-cinder-786383-6-iscsi {{(pid=98393) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 16:25:23.081023 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1708360', 'neutron.services.segments.db._delete_segments_for_network-8792484777948'] for network, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.087971 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 913bd645-8ded-4389-a7b8-766f2aa204fb no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:23.095913 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['65e6b112-9bac-41d1-bbe8-8197e6a41377']}} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:23.109160 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '84c0121f-ea27-4a7d-a8a0-592be916b665') {'for_net_delete': True} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:23.109381 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.services.segments.db [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '84c0121f-ea27-4a7d-a8a0-592be916b665') {} {{(pid=98392) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:25:23.121582 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8792484787357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3286853'] for segment, before_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.125083 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 913bd645-8ded-4389-a7b8-766f2aa204fb {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:23.125470 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 913bd645-8ded-4389-a7b8-766f2aa204fb not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:23.125945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:23.139720 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048'] for segment, precommit_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.149634 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Releasing vlan 800 on physical network physnet1 to pool {{(pid=98392) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:25:23.150185 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1720048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3358691'] for segment, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: Traceback (most recent call last): May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: timer() May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: cb(*args, **kw) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: return func(*args, **kwargs) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: self._notify() May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: self.callback(batched_events) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: event.method(event) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: return f(self, *a, **k) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._get(url).json() May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: return self.request(url, 'GET', **kwargs) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:25:23.166056 dv-cinder-786383-6-iscsi neutron-server[98392]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:25:23.168534 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:23.169078 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device cf18ab87-678c-4e70-bdd7-eda7cc40ebf6 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:23.169785 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 64a0d5a5-3221-4b1d-a541-c372770cc636 no longer exists at agent ovs-agent-dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 16:25:23.211740 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.plugin [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] No Port match for: 64a0d5a5-3221-4b1d-a541-c372770cc636 {{(pid=98393) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 16:25:23.212092 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron.plugins.ml2.rpc [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Device 64a0d5a5-3221-4b1d-a541-c372770cc636 not bound to the agent host dv-cinder-786383-6-iscsi {{(pid=98393) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 16:25:23.300992 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1708353', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-460579', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-408107'] for network, after_delete {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.306378 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-658186a2-93f1-443c-af5f-2448d364a47e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:23.320943 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron_lib.callbacks.manager [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587661'] for network, before_response {{(pid=98392) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.331479 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Pushing event deleted for resources: {'Network': ['ID=65e6b112-9bac-41d1-bbe8-8197e6a41377,revision_number=None']} {{(pid=98392) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:23.335852 dv-cinder-786383-6-iscsi neutron-server[98392]: DEBUG oslo_concurrency.lockutils [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:23.339403 dv-cinder-786383-6-iscsi neutron-server[98392]: INFO neutron.wsgi [None req-a8de6e40-6b43-40eb-be92-ca672d16e8b2 admin admin] 10.222.0.25 "DELETE /v2.0/networks/65e6b112-9bac-41d1-bbe8-8197e6a41377 HTTP/1.1" status: 204 len: 168 time: 0.9968369 May 25 16:25:23.456057 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56768) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:23.505651 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-631ad2d0-7f0f-4ab3-aca6-703c260899fe admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a899ba7d8bc0472caa53a2e65d1bd7ea&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0483530 May 25 16:25:23.507951 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56772) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:23.569318 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.594660 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.647529 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.651272 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-33a1db2f-423f-4ddd-b888-5484472ba828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:23.664700 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acce15bb-f5e2-4fb7-8292-46061d719da1,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:23.674633 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.675032 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.675399 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.675788 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.680595 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786383-6-iscsi {{(pid=98391) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:25:23.683195 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:23.687722 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:23.689004 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-19843128-adf4-40fd-b657-b6c18c3c027b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/acce15bb-f5e2-4fb7-8292-46061d719da1 HTTP/1.1" status: 204 len: 168 time: 0.1801753 May 25 16:25:24.029352 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56780) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:24.077217 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-1360872a-b5de-4331-9407-4d72d7e08cd6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=071fa67adcc445f7a4fb235d75abef7c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0465164 May 25 16:25:24.079771 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.wsgi [-] (98391) accepted ('10.222.0.25', 56784) {{(pid=98391) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:25:24.137735 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:24.163227 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:24.219441 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-460611'] for security_group, after_delete {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:24.224691 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-8512b1e5-78d8-4450-9781-a2bb83013908 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:25:24.236256 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cdbdb4d-9753-436b-ad8b-cbd08728b594,revision_number=None']} {{(pid=98391) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:25:24.239911 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG oslo_concurrency.lockutils [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:25:24.241836 dv-cinder-786383-6-iscsi neutron-server[98391]: DEBUG neutron_lib.callbacks.manager [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98391) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:24.242882 dv-cinder-786383-6-iscsi neutron-server[98391]: INFO neutron.wsgi [None req-cbd3ceae-333e-4f25-96ec-39d53437b0eb admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8cdbdb4d-9753-436b-ad8b-cbd08728b594 HTTP/1.1" status: 204 len: 168 time: 0.1619692 May 25 16:25:29.271716 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-01505d7e-0060-4d6a-8738-6df73b6439bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:31.613638 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:31.805085 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-127c2949-dbb3-4ebe-af13-4d13551dc822 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:32.932120 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:34.649143 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:36.389828 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:25:52.443015 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:25:59.274412 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-39af2a58-2246-4d81-89e3-c6efb8cc2e35 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:01.619277 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:01.807305 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2bc7f1fc-add5-41ea-9759-49185251a421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:02.935571 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:04.648971 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:06.412232 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:29.276409 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-85091dad-7d70-42b2-aa9e-edd003777964 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:29.442199 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:26:31.622142 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:31.809184 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-91d1174e-138a-4181-a808-2f142634765f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:32.937951 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:34.652681 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:36.417945 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:26:59.278052 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ddc0b9a9-27ba-44c3-991d-6eee4e03acb1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:01.626641 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:01.812058 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-801c389b-c59d-4fc2-8c99-5f60bccf62f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:02.940710 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:04.656269 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:06.423313 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:06.439629 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:27:29.280379 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-86aa9de2-48e5-4661-935c-c545269f211c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:31.620045 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:31.817532 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-89eb6bc5-b6b9-4d11-944d-97a2a092b0ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:32.944758 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:34.662918 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:36.430100 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:27:43.438052 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:27:59.284591 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-989569f7-468b-43a2-ae66-3455e2fa0db1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:01.623393 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:01.818196 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6df3677b-e905-44c9-984f-2bfc56cc3c61 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:02.947147 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:04.660279 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:06.425532 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:20.436768 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:28:29.286234 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-1ebfa56d-b64e-497b-bb09-4f09b7dd7c0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:31.628083 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:31.819808 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-6903a988-b9b9-4a51-a3fa-8aabbe0a2f28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:32.950735 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:34.657935 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:36.420961 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:28:57.436077 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:28:59.290574 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ba355ad3-8b64-437d-b173-21b8fba07db2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:01.632453 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:01.838483 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f92ddd8e-d21f-452b-bf97-828fce194ede None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:02.956900 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:04.662435 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:06.481472 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:29.293954 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-ab6d0f4b-c657-4534-90b0-e8a2f9b98465 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:31.636523 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:31.821627 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d479b87a-c58e-412b-9ef6-afc537781852 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:32.957274 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:34.434617 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:29:34.666129 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:36.484174 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:29:59.295915 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-f555eb0b-759a-4f1a-8327-8780d365594f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:01.639618 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-9fce1d90-2bf5-47d2-86c3-c0bda82a5ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:01.824338 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2c33b8a0-0858-4f5e-a700-a7f25dfc158f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:02.969365 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-d29651f5-91e8-4580-89b5-e2f9ba3f1df9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:04.668192 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-aa6c7df0-f913-4c7e-84f7-4798c45d289f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:06.492498 dv-cinder-786383-6-iscsi neutron-server[98393]: DEBUG neutron_lib.callbacks.manager [None req-2a379cc2-381f-45f8-adeb-42f660208950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8792484777966', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1710982'] for agent, after_update {{(pid=98393) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:30:11.433854 dv-cinder-786383-6-iscsi neutron-server[98394]: DEBUG neutron.db.agents_db [None req-cade3259-dbf2-4ba5-80cf-6b58532c90ae None None] Agent healthcheck: found 6 active agents {{(pid=98394) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}